2019-12-19T21:54:07.666 INFO:root:teuthology version: 1.0.0-22f3bf0 2019-12-19T21:54:07.667 DEBUG:teuthology.run:Teuthology command: teuthology /tmp/teuthology-worker.oF2CHk.tmp -- --verbose --lock --description rados/singleton-nomsgr/{all/cache-fs-trunc.yaml rados.yaml supported-random-distro$/{rhel_8.yaml}} --name sjust-2019-12-19_20:06:11-rados-wip-sjust-read-from-replica-distro-basic-smithi --block --owner scheduled_sjust@teuthology --archive /home/teuthworker/archive/sjust-2019-12-19_20:06:11-rados-wip-sjust-read-from-replica-distro-basic-smithi/4615662 2019-12-19T21:54:07.706 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-12-19T21:54:07.860 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/sjust-2019-12-19_20:06:11-rados-wip-sjust-read-from-replica-distro-basic-smithi/4615662 branch: wip-sjust-read-from-replica description: rados/singleton-nomsgr/{all/cache-fs-trunc.yaml rados.yaml supported-random-distro$/{rhel_8.yaml}} email: null first_in_suite: false job_id: '4615662' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: sjust-2019-12-19_20:06:11-rados-wip-sjust-read-from-replica-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: rhel os_version: '8.0' overrides: admin_socket: branch: wip-sjust-read-from-replica ceph: conf: mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug filestore: 20 debug journal: 20 debug ms: 1 debug osd: 25 osd debug verify cached snaps: true osd debug verify missing on start: true osd op queue: debug_random osd op queue cut off: debug_random log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 368c5a40f375d6b61b7b988b7a7f4598540a0665 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: sha1: 368c5a40f375d6b61b7b988b7a7f4598540a0665 workunit: branch: wip-sjust-read-from-replica sha1: 368c5a40f375d6b61b7b988b7a7f4598540a0665 owner: scheduled_sjust@teuthology priority: 91 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - osd.0 - osd.1 - osd.2 - client.0 - client.1 sha1: 368c5a40f375d6b61b7b988b7a7f4598540a0665 suite: rados suite_branch: wip-sjust-read-from-replica suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_wip-sjust-read-from-replica/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 368c5a40f375d6b61b7b988b7a7f4598540a0665 tasks: - install: null - ceph: conf: global: debug client: 20 debug mds: 20 debug ms: 1 osd max object name len: 460 osd max object namespace len: 64 log-whitelist: - overall HEALTH_ - \(CACHE_POOL_NO_HIT_SET\) - exec: client.0: - ceph osd pool create data_cache 4 - ceph osd tier add cephfs_data data_cache - ceph osd tier cache-mode data_cache writeback - ceph osd tier set-overlay cephfs_data data_cache - ceph osd pool set data_cache hit_set_type bloom - ceph osd pool set data_cache hit_set_count 8 - ceph osd pool set data_cache hit_set_period 3600 - ceph osd pool set data_cache min_read_recency_for_promote 0 - ceph-fuse: null - exec: client.0: - sudo chmod 777 $TESTDIR/mnt.0/ - dd if=/dev/urandom of=$TESTDIR/mnt.0/foo bs=1M count=5 - ls -al $TESTDIR/mnt.0/foo - truncate --size 0 $TESTDIR/mnt.0/foo - ls -al $TESTDIR/mnt.0/foo - dd if=/dev/urandom of=$TESTDIR/mnt.0/foo bs=1M count=5 - ls -al $TESTDIR/mnt.0/foo - cp $TESTDIR/mnt.0/foo /tmp/foo - sync - rados -p data_cache ls - - sleep 10 - rados -p data_cache ls - - rados -p data_cache cache-flush-evict-all - rados -p data_cache ls - - sleep 1 - exec: client.1: - hexdump -C /tmp/foo | head - hexdump -C $TESTDIR/mnt.1/foo | head - cmp $TESTDIR/mnt.1/foo /tmp/foo teuthology_branch: master tube: smithi verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.22728 2019-12-19T21:54:07.860 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_wip-sjust-read-from-replica/qa; will attempt to use it 2019-12-19T21:54:07.861 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_wip-sjust-read-from-replica/qa/tasks 2019-12-19T21:54:07.861 INFO:teuthology.run_tasks:Running task internal.check_packages... 2019-12-19T21:54:07.871 INFO:teuthology.task.internal:Checking packages... 2019-12-19T21:54:07.893 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'basic' and ceph hash '368c5a40f375d6b61b7b988b7a7f4598540a0665' 2019-12-19T21:54:07.894 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2019-12-19T21:54:07.894 INFO:teuthology.packaging:ref: None 2019-12-19T21:54:07.894 INFO:teuthology.packaging:tag: None 2019-12-19T21:54:07.894 INFO:teuthology.packaging:branch: wip-sjust-read-from-replica 2019-12-19T21:54:07.894 INFO:teuthology.packaging:sha1: 368c5a40f375d6b61b7b988b7a7f4598540a0665 2019-12-19T21:54:07.894 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-sjust-read-from-replica 2019-12-19T21:54:08.094 INFO:teuthology.task.internal:Found packages for ceph version 15.0.0-8663.g368c5a4 2019-12-19T21:54:08.094 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2019-12-19T21:54:08.106 INFO:teuthology.task.internal:no buildpackages task found 2019-12-19T21:54:08.107 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2019-12-19T21:54:08.177 INFO:teuthology.task.internal.lock_machines:Locking machines... 2019-12-19T21:54:08.177 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-12-19T21:54:08.240 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 1, have 2)... 2019-12-19T21:54:18.257 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 1, have 2)... 2019-12-19T21:54:28.277 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 1, have 2)... 2019-12-19T21:54:38.293 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 1, have 2)... 2019-12-19T21:54:48.310 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 1, have 2)... 2019-12-19T21:54:58.327 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 1, have 2)... 2019-12-19T21:55:08.346 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 1, have 2)... 2019-12-19T21:55:18.361 DEBUG:teuthology.lock.ops:lock_many request: {'count': 1, 'locked_by': 'scheduled_sjust@teuthology', 'description': '/home/teuthworker/archive/sjust-2019-12-19_20:06:11-rados-wip-sjust-read-from-replica-distro-basic-smithi/4615662', 'machine_type': 'smithi'} 2019-12-19T21:55:18.392 DEBUG:teuthology.lock.ops:locked ubuntu@smithi050.front.sepia.ceph.com 2019-12-19T21:55:18.438 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2019-12-19T21:55:18.646 INFO:teuthology.provision.fog.smithi050:Scheduling deploy of rhel 8.0 2019-12-19T21:55:19.118 INFO:teuthology.orchestra.console:Power off smithi050 2019-12-19T21:55:19.118 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2019-12-19T21:55:19.146 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-19T21:55:23.180 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-19T21:55:27.293 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-19T21:55:27.506 INFO:teuthology.orchestra.console:Power off for smithi050 completed 2019-12-19T21:55:27.609 INFO:teuthology.orchestra.console:Power on smithi050 2019-12-19T21:55:27.609 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2019-12-19T21:55:27.640 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-19T21:55:31.668 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-19T21:55:35.780 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-19T21:55:35.997 INFO:teuthology.orchestra.console:Power on for smithi050 completed 2019-12-19T21:55:36.098 INFO:teuthology.provision.fog.smithi050:Waiting for deploy to finish 2019-12-19T21:58:07.500 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi050.front.sepia.ceph.com', 'timeout': 60} 2019-12-19T21:58:16.557 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi050.front.sepia.ceph.com', 'timeout': 60} 2019-12-19T21:58:25.613 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi050.front.sepia.ceph.com', 'timeout': 60} 2019-12-19T21:58:34.671 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi050.front.sepia.ceph.com', 'timeout': 60} 2019-12-19T21:58:43.765 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi050.front.sepia.ceph.com', 'timeout': 60} 2019-12-19T21:58:52.845 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi050.front.sepia.ceph.com', 'timeout': 60} 2019-12-19T21:59:58.849 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi050.front.sepia.ceph.com', 'timeout': 60} 2019-12-19T21:59:59.118 INFO:teuthology.orchestra.run.smithi050:> hostname 2019-12-19T21:59:59.423 INFO:teuthology.orchestra.run.smithi050.stdout:smithi050.front.sepia.ceph.com 2019-12-19T21:59:59.423 INFO:teuthology.orchestra.run.smithi050:> grep smithi050.front.sepia.ceph.com /etc/hosts 2019-12-19T21:59:59.480 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50 smithi050.front.sepia.ceph.com smithi050 2019-12-19T21:59:59.480 INFO:teuthology.orchestra.run.smithi050:> sudo hostname smithi050 2019-12-19T21:59:59.617 INFO:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/smithi050.front.sepia.ceph.com/smithi050/g' /etc/hosts 2019-12-19T21:59:59.650 INFO:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/172.21.15.50/172.21.15.50/g' /etc/hosts 2019-12-19T21:59:59.722 INFO:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/smithi050.front.sepia.ceph.com/smithi050/g' /etc/hostname 2019-12-19T21:59:59.794 INFO:teuthology.orchestra.run.smithi050:> sudo hostname smithi050 2019-12-19T21:59:59.867 INFO:teuthology.provision.fog.smithi050:Deploy complete! 2019-12-19T21:59:59.872 DEBUG:teuthology.parallel:result is None 2019-12-19T21:59:59.993 INFO:teuthology.lock.ops:Checking smithi050.front.sepia.ceph.com 2019-12-19T21:59:59.994 INFO:teuthology.lock.ops:New key found. Updating... 2019-12-19T22:00:00.018 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: set os type and version on server 2019-12-19T22:00:00.018 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-19T22:00:00.019 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi050.front.sepia.ceph.com', 'timeout': 60} 2019-12-19T22:00:00.132 INFO:teuthology.orchestra.run.smithi050:> true 2019-12-19T22:00:00.308 INFO:teuthology.orchestra.run.smithi050:> uname -m 2019-12-19T22:00:00.363 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64 2019-12-19T22:00:00.363 INFO:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2019-12-19T22:00:00.417 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="Red Hat Enterprise Linux" 2019-12-19T22:00:00.418 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="8.0 (Ootpa)" 2019-12-19T22:00:00.418 INFO:teuthology.orchestra.run.smithi050.stdout:ID="rhel" 2019-12-19T22:00:00.418 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="fedora" 2019-12-19T22:00:00.418 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="8.0" 2019-12-19T22:00:00.418 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el8" 2019-12-19T22:00:00.418 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.0 (Ootpa)" 2019-12-19T22:00:00.419 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31" 2019-12-19T22:00:00.419 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.0:GA" 2019-12-19T22:00:00.420 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://www.redhat.com/" 2019-12-19T22:00:00.421 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2019-12-19T22:00:00.421 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:00:00.421 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2019-12-19T22:00:00.421 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.0 2019-12-19T22:00:00.421 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2019-12-19T22:00:00.421 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.0" 2019-12-19T22:00:00.423 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2019-12-19T22:00:00.442 INFO:teuthology.task.internal.lock_machines:1 smithi machines locked this try, 1/1 locked so far 2019-12-19T22:00:00.462 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi050.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHoLc37hEFjrkHVo88aK6CoYNX3fXCnBBSTlYnd0/SItFCzGdnyPXF6N5APIs9IZCyNZT+1dyR6YXYd/FAAlkAUZlPsKhC+ZPhyNDXqOhrk6/5mDRWcB0nvXMtrt/uo0FRbSN2hEX9uRCsdyZMo/iAsQpaaCqrgCbIlI0xJxiQYRrsv/hG8uM0Rt9OHkpM2TRMeAFI9BH8LDSepadqCn7omc5lHdr/Xa7lhYn1tF1JblsajjpF7S/CdWNhM9VsblZq1eQ/GG25qP2SJtSMzVwa2cjRsTWcHjxEb+dkUIEqzD7I5mql98sBhMb18W1IBncAuMMZFZ4lRPGEnAFSXQ/j 2019-12-19T22:00:00.462 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-12-19T22:00:00.512 INFO:teuthology.run_tasks:Running task internal.save_config... 2019-12-19T22:00:00.516 INFO:teuthology.task.internal:Saving configuration 2019-12-19T22:00:00.530 INFO:teuthology.run_tasks:Running task internal.check_lock... 2019-12-19T22:00:00.539 INFO:teuthology.task.internal.check_lock:Checking locks... 2019-12-19T22:00:00.555 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2019-12-19 21:55:18.367131', u'locked_by': u'scheduled_sjust@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi050.front.sepia.ceph.com', u'os_version': u'8.0', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'rhel', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN9qFlZ4HF8f+bI88+H14QJ4kZ/AJCShe6xrNyKDChVpWK1d5upfREWGm/sSdhyv4yv8mey3WK5JotRuYzFMuNA=', u'description': u'/home/teuthworker/archive/sjust-2019-12-19_20:06:11-rados-wip-sjust-read-from-replica-distro-basic-smithi/4615662'} 2019-12-19T22:00:00.555 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2019-12-19T22:00:00.563 INFO:teuthology.task.internal:roles: ubuntu@smithi050.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'client.0', 'client.1'] 2019-12-19T22:00:00.563 INFO:teuthology.run_tasks:Running task console_log... 2019-12-19T22:00:00.641 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2019-12-19T22:00:00.642 INFO:teuthology.run_tasks:Running task internal.connect... 2019-12-19T22:00:00.652 INFO:teuthology.task.internal:Opening connections... 2019-12-19T22:00:00.652 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi050.front.sepia.ceph.com 2019-12-19T22:00:00.653 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi050.front.sepia.ceph.com', 'timeout': 60} 2019-12-19T22:00:00.727 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2019-12-19T22:00:00.738 INFO:teuthology.orchestra.run.smithi050:> uname -m 2019-12-19T22:00:00.903 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64 2019-12-19T22:00:00.904 INFO:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2019-12-19T22:00:00.958 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="Red Hat Enterprise Linux" 2019-12-19T22:00:00.958 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="8.0 (Ootpa)" 2019-12-19T22:00:00.959 INFO:teuthology.orchestra.run.smithi050.stdout:ID="rhel" 2019-12-19T22:00:00.959 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="fedora" 2019-12-19T22:00:00.959 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="8.0" 2019-12-19T22:00:00.959 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el8" 2019-12-19T22:00:00.959 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.0 (Ootpa)" 2019-12-19T22:00:00.960 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31" 2019-12-19T22:00:00.960 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.0:GA" 2019-12-19T22:00:00.968 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://www.redhat.com/" 2019-12-19T22:00:00.968 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2019-12-19T22:00:00.968 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:00:00.968 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2019-12-19T22:00:00.968 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.0 2019-12-19T22:00:00.969 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2019-12-19T22:00:00.969 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.0" 2019-12-19T22:00:00.969 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2019-12-19T22:00:00.985 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2019-12-19T22:00:01.016 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2019-12-19T22:00:01.034 INFO:teuthology.task.internal:Checking for old test directory... 2019-12-19T22:00:01.034 INFO:teuthology.orchestra.run.smithi050:> test '!' -e /home/ubuntu/cephtest 2019-12-19T22:00:01.048 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2019-12-19T22:00:01.060 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2019-12-19T22:00:01.060 INFO:teuthology.orchestra.run.smithi050:> test -z $(ls -A /var/lib/ceph) 2019-12-19T22:00:01.112 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2019-12-19T22:00:01.145 INFO:teuthology.run_tasks:Running task kernel... 2019-12-19T22:00:01.169 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'client.0': {'sha1': 'distro', 'kdb': True}, 'mds.a': {'sha1': 'distro', 'kdb': True}, 'osd.1': {'sha1': 'distro', 'kdb': True}, 'osd.0': {'sha1': 'distro', 'kdb': True}, 'client.1': {'sha1': 'distro', 'kdb': True}, 'osd.2': {'sha1': 'distro', 'kdb': True}, 'mgr.x': {'sha1': 'distro', 'kdb': True}} 2019-12-19T22:00:01.169 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro', 'kdb': True}}, timeout 300 2019-12-19T22:00:01.169 INFO:teuthology.orchestra.run.smithi050:> uname -r 2019-12-19T22:00:01.184 INFO:teuthology.orchestra.run.smithi050.stdout:4.18.0-80.11.2.el8_0.x86_64 2019-12-19T22:00:01.184 INFO:teuthology.task.kernel:Running kernel on smithi050: 4.18.0-80.11.2.el8_0.x86_64 2019-12-19T22:00:01.185 INFO:teuthology.orchestra.run.smithi050:> sudo yum install -y kernel 2019-12-19T22:00:02.897 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2019-12-19T22:00:02.897 INFO:teuthology.orchestra.run.smithi050.stdout:Unable to read consumer identity 2019-12-19T22:00:03.080 INFO:teuthology.orchestra.run.smithi050.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2019-12-19T22:00:04.309 INFO:teuthology.orchestra.run.smithi050.stdout:Extra Packages for Enterprise Linux 8 - x86_64 65 kB/s | 20 kB 00:00 2019-12-19T22:00:10.473 INFO:teuthology.orchestra.run.smithi050.stdout:Extra Packages for Enterprise Linux 8 - x86_64 717 kB/s | 4.3 MB 00:06 2019-12-19T22:00:11.450 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:00:05 ago on Thu 19 Dec 2019 10:00:06 PM UTC. 2019-12-19T22:00:11.700 INFO:teuthology.orchestra.run.smithi050.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2019-12-19T22:00:11.700 INFO:teuthology.orchestra.run.smithi050.stdout:Package kernel-4.18.0-80.11.2.el8_0.x86_64 is already installed. 2019-12-19T22:00:11.784 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2019-12-19T22:00:11.785 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2019-12-19T22:00:11.785 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2019-12-19T22:00:11.908 INFO:teuthology.orchestra.run.smithi050:> echo no | sudo yum reinstall kernel || true 2019-12-19T22:00:12.262 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2019-12-19T22:00:12.262 INFO:teuthology.orchestra.run.smithi050.stdout:Unable to read consumer identity 2019-12-19T22:00:12.370 INFO:teuthology.orchestra.run.smithi050.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2019-12-19T22:00:12.492 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:00:06 ago on Thu 19 Dec 2019 10:00:06 PM UTC. 2019-12-19T22:00:12.575 INFO:teuthology.orchestra.run.smithi050.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2019-12-19T22:00:12.575 INFO:teuthology.orchestra.run.smithi050.stdout:Installed package kernel-4.18.0-80.11.2.el8_0.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2019-12-19T22:00:12.625 INFO:teuthology.orchestra.run.smithi050.stderr:Error: No packages marked for reinstall. 2019-12-19T22:00:12.724 INFO:teuthology.orchestra.run.smithi050:> sudo yum reinstall -y kernel || true 2019-12-19T22:00:13.072 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2019-12-19T22:00:13.072 INFO:teuthology.orchestra.run.smithi050.stdout:Unable to read consumer identity 2019-12-19T22:00:13.296 INFO:teuthology.orchestra.run.smithi050.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2019-12-19T22:00:13.419 INFO:teuthology.orchestra.run.smithi050.stdout:Last metadata expiration check: 0:00:07 ago on Thu 19 Dec 2019 10:00:06 PM UTC. 2019-12-19T22:00:13.509 INFO:teuthology.orchestra.run.smithi050.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2019-12-19T22:00:13.510 INFO:teuthology.orchestra.run.smithi050.stdout:Installed package kernel-4.18.0-80.11.2.el8_0.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2019-12-19T22:00:13.562 INFO:teuthology.orchestra.run.smithi050.stderr:Error: No packages marked for reinstall. 2019-12-19T22:00:13.622 INFO:teuthology.orchestra.run.smithi050:> rpm -q kernel --last | head -n 1 2019-12-19T22:00:13.655 INFO:teuthology.orchestra.run.smithi050.stdout:kernel-4.18.0-80.11.2.el8_0.x86_64 Wed 11 Dec 2019 02:25:38 PM UTC 2019-12-19T22:00:13.656 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-80.11.2.el8_0.x86_64 2019-12-19T22:00:13.656 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2019-12-19T22:00:13.657 INFO:teuthology.orchestra.run.smithi050:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2019-12-19T22:00:13.733 INFO:teuthology.orchestra.run.smithi050.stdout:ttyS1 2019-12-19T22:00:13.744 INFO:teuthology.run_tasks:Running task internal.base... 2019-12-19T22:00:13.755 INFO:teuthology.task.internal:Creating test directory... 2019-12-19T22:00:13.755 INFO:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2019-12-19T22:00:13.799 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2019-12-19T22:00:13.819 INFO:teuthology.run_tasks:Running task internal.archive... 2019-12-19T22:00:13.832 INFO:teuthology.task.internal:Creating archive directory... 2019-12-19T22:00:13.833 INFO:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2019-12-19T22:00:13.860 INFO:teuthology.run_tasks:Running task internal.coredump... 2019-12-19T22:00:13.871 INFO:teuthology.task.internal:Enabling coredump saving... 2019-12-19T22:00:13.871 INFO:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-12-19T22:00:13.932 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-12-19T22:00:13.933 INFO:teuthology.run_tasks:Running task internal.sudo... 2019-12-19T22:00:13.947 INFO:teuthology.task.internal:Configuring sudo... 2019-12-19T22:00:13.947 INFO:teuthology.orchestra.run.smithi050:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2019-12-19T22:00:14.005 INFO:teuthology.run_tasks:Running task internal.syslog... 2019-12-19T22:00:14.034 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2019-12-19T22:00:14.034 INFO:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2019-12-19T22:00:14.063 INFO:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2019-12-19T22:00:14.135 INFO:teuthology.orchestra.run.smithi050:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2019-12-19T22:00:14.207 INFO:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2019-12-19T22:00:14.278 INFO:teuthology.orchestra.run.smithi050:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2019-12-19T22:00:14.333 INFO:teuthology.orchestra.run.smithi050:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2019-12-19T22:00:14.419 INFO:teuthology.orchestra.run.smithi050:> sudo service rsyslog restart 2019-12-19T22:00:14.522 INFO:teuthology.orchestra.run.smithi050.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2019-12-19T22:00:14.959 INFO:teuthology.run_tasks:Running task internal.timer... 2019-12-19T22:00:14.976 INFO:teuthology.task.internal:Starting timer... 2019-12-19T22:00:14.976 INFO:teuthology.run_tasks:Running task pcp... 2019-12-19T22:00:15.016 INFO:teuthology.run_tasks:Running task selinux... 2019-12-19T22:00:15.031 INFO:teuthology.orchestra.run.smithi050:> sudo service auditd rotate 2019-12-19T22:00:15.089 INFO:teuthology.orchestra.run.smithi050.stdout:Rotating logs: [ OK ] 2019-12-19T22:00:15.091 DEBUG:teuthology.task.selinux:Getting current SELinux state 2019-12-19T22:00:15.091 INFO:teuthology.orchestra.run.smithi050:> /usr/sbin/getenforce 2019-12-19T22:00:15.114 INFO:teuthology.orchestra.run.smithi050.stdout:Permissive 2019-12-19T22:00:15.115 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi050.front.sepia.ceph.com': 'permissive'} 2019-12-19T22:00:15.115 INFO:teuthology.orchestra.run.smithi050:> sudo grep 'avc: .*denied' /var/log/audit/audit.log | grep -v '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\)' 2019-12-19T22:00:15.188 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-12-19T22:00:15.189 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2019-12-19T22:00:15.189 INFO:teuthology.orchestra.run.smithi050:> sudo /usr/sbin/setenforce permissive 2019-12-19T22:00:15.260 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2019-12-19T22:00:15.284 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated; assuming it is current 2019-12-19T22:00:15.284 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2019-12-19T22:00:15.307 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2019-12-19T22:00:15.315 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi050.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2019-12-19T22:00:15.732 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2019-12-19T22:00:17.168 INFO:teuthology.task.ansible.out: [WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2019-12-19T22:00:20.323 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2019-12-19T22:00:20.346 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:00:20 +0000 (0:00:00.073) 0:00:00.073 ***** 2019-12-19T22:00:23.081 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi050.front.sepia.ceph.com] 2019-12-19T22:00:23.156 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:00:23 +0000 (0:00:02.809) 0:00:02.883 ***** 2019-12-19T22:00:23.579 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-12-19T22:00:23.637 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:00:23 +0000 (0:00:00.479) 0:00:03.362 ***** 2019-12-19T22:00:24.239 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** ok: [smithi050.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2019-12-19T22:00:24.276 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:00:24 +0000 (0:00:00.640) 0:00:04.003 ***** 2019-12-19T22:00:24.302 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:00:24.340 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:00:24 +0000 (0:00:00.063) 0:00:04.067 ***** 2019-12-19T22:00:24.708 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2019-12-19T22:00:24.711 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-19T22:00:24.762 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:00:24 +0000 (0:00:00.415) 0:00:04.483 ***** 2019-12-19T22:00:25.985 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** changed: [smithi050.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1576792824.77-240265365772169/source", "state": "file", "uid": 0} 2019-12-19T22:00:26.028 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:00:26 +0000 (0:00:01.269) 0:00:05.752 ***** 2019-12-19T22:00:26.684 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* ok: [smithi050.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-19T22:00:26.973 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-19T22:00:27.269 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-19T22:00:27.600 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-19T22:00:27.899 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-19T22:00:28.207 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-19T22:00:28.531 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-19T22:00:28.653 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2019-12-19T22:00:28.668 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2019-12-19T22:00:28.898 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:00:28 +0000 (0:00:02.872) 0:00:08.625 ***** 2019-12-19T22:00:29.616 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2019-12-19T22:00:29.618 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] 2019-12-19T22:00:29.754 INFO:teuthology.task.ansible.out: [WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. Thursday 19 December 2019 22:00:29 +0000 (0:00:00.847) 0:00:09.473 ***** 2019-12-19T22:00:30.382 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2019-12-19T22:00:30.383 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.296781", "end": "2019-12-19 22:00:30.357977", "rc": 0, "start": "2019-12-19 22:00:30.061196", "stderr": "", "stderr_lines": [], "stdout": "f4e10beea550ddcc5081090533acfa405cd36c43", "stdout_lines": ["f4e10beea550ddcc5081090533acfa405cd36c43"]} 2019-12-19T22:00:30.436 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:00:30 +0000 (0:00:00.689) 0:00:10.163 ***** 2019-12-19T22:00:30.674 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2019-12-19T22:00:30.675 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.013160", "end": "2019-12-19 22:00:30.652365", "failed_when_result": false, "rc": 0, "start": "2019-12-19 22:00:30.639205", "stderr": "", "stderr_lines": [], "stdout": "c84d080fc97e482f88d240859322d5765ac90366", "stdout_lines": ["c84d080fc97e482f88d240859322d5765ac90366"]} 2019-12-19T22:00:30.757 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:00:30 +0000 (0:00:00.320) 0:00:10.484 ***** 2019-12-19T22:00:30.812 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:00:30.864 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:00:30 +0000 (0:00:00.103) 0:00:10.588 ***** 2019-12-19T22:00:30.898 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2019-12-19T22:00:30.899 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:00:30.955 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:00:30 +0000 (0:00:00.094) 0:00:10.682 ***** 2019-12-19T22:00:30.991 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2019-12-19T22:00:30.996 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:00:31.040 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:00:31 +0000 (0:00:00.082) 0:00:10.765 ***** 2019-12-19T22:00:31.064 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:00:31.104 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:00:31 +0000 (0:00:00.062) 0:00:10.828 ***** 2019-12-19T22:00:31.137 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:00:31.181 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:00:31 +0000 (0:00:00.077) 0:00:10.905 ***** 2019-12-19T22:00:31.404 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2019-12-19T22:00:31.406 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-19T22:00:31.451 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:00:31 +0000 (0:00:00.272) 0:00:11.178 ***** 2019-12-19T22:00:31.725 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2019-12-19T22:00:31.957 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2019-12-19T22:00:32.171 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2019-12-19T22:00:32.414 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/adeza", "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "move_home": false, "name": "adeza", "shell": "/bin/bash", "state": "present", "uid": 1104} 2019-12-19T22:00:32.650 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1105} 2019-12-19T22:00:32.889 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1106} 2019-12-19T22:00:33.110 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1107} 2019-12-19T22:00:33.343 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1108} 2019-12-19T22:00:33.569 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2019-12-19T22:00:33.797 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2019-12-19T22:00:34.012 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2019-12-19T22:00:34.229 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2019-12-19T22:00:34.451 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2019-12-19T22:00:34.675 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2019-12-19T22:00:34.895 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2019-12-19T22:00:35.124 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2019-12-19T22:00:35.350 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2019-12-19T22:00:35.563 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2019-12-19T22:00:35.796 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2019-12-19T22:00:36.021 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2019-12-19T22:00:36.258 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2019-12-19T22:00:36.469 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1122} 2019-12-19T22:00:36.690 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1123} 2019-12-19T22:00:36.929 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1124} 2019-12-19T22:00:37.149 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1125} 2019-12-19T22:00:37.364 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1126} 2019-12-19T22:00:37.582 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1127} 2019-12-19T22:00:37.811 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1128} 2019-12-19T22:00:38.059 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1129} 2019-12-19T22:00:38.274 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1130} 2019-12-19T22:00:38.493 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1131} 2019-12-19T22:00:38.707 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1132} 2019-12-19T22:00:38.966 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1133} 2019-12-19T22:00:39.174 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1134} 2019-12-19T22:00:39.398 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1135} 2019-12-19T22:00:39.637 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1136} 2019-12-19T22:00:39.864 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1137} 2019-12-19T22:00:40.097 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1138} 2019-12-19T22:00:40.320 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1139} 2019-12-19T22:00:40.552 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2019-12-19T22:00:40.770 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1141} 2019-12-19T22:00:40.991 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-12-19T22:00:41.211 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1143} 2019-12-19T22:00:41.429 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1144} 2019-12-19T22:00:41.660 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1145} 2019-12-19T22:00:41.902 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1146} 2019-12-19T22:00:42.142 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1147} 2019-12-19T22:00:42.366 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2019-12-19T22:00:42.588 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1149} 2019-12-19T22:00:42.831 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1150} 2019-12-19T22:00:43.049 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1151} 2019-12-19T22:00:43.260 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1152} 2019-12-19T22:00:43.510 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1153} 2019-12-19T22:00:43.728 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1154} 2019-12-19T22:00:43.939 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-12-19T22:00:44.159 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1156} 2019-12-19T22:00:44.386 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1157} 2019-12-19T22:00:44.610 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1158} 2019-12-19T22:00:44.832 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1159} 2019-12-19T22:00:45.054 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1160} 2019-12-19T22:00:45.275 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1161} 2019-12-19T22:00:45.506 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1162} 2019-12-19T22:00:45.771 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1163} 2019-12-19T22:00:45.987 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1164} 2019-12-19T22:00:46.198 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2019-12-19T22:00:46.436 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2019-12-19T22:00:46.651 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1166} 2019-12-19T22:00:46.873 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1167} 2019-12-19T22:00:47.095 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1168} 2019-12-19T22:00:47.314 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1169} 2019-12-19T22:00:47.546 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1170} 2019-12-19T22:00:47.766 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1171} 2019-12-19T22:00:48.005 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1172} 2019-12-19T22:00:48.247 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1173} 2019-12-19T22:00:48.482 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1174} 2019-12-19T22:00:48.701 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1175} 2019-12-19T22:00:48.917 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1176} 2019-12-19T22:00:49.152 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1177} 2019-12-19T22:00:49.402 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1178} 2019-12-19T22:00:49.667 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1179} 2019-12-19T22:00:49.881 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1180} 2019-12-19T22:00:50.120 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1181} 2019-12-19T22:00:50.343 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1182} 2019-12-19T22:00:50.574 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1183} 2019-12-19T22:00:50.813 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1184} 2019-12-19T22:00:51.070 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1185} 2019-12-19T22:00:51.296 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1186} 2019-12-19T22:00:51.518 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1187} 2019-12-19T22:00:51.757 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1188} 2019-12-19T22:00:51.953 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1189} 2019-12-19T22:00:52.178 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1190} 2019-12-19T22:00:52.409 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1191} 2019-12-19T22:00:52.626 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1192} 2019-12-19T22:00:52.836 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1193} 2019-12-19T22:00:53.067 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1194} 2019-12-19T22:00:53.288 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1195} 2019-12-19T22:00:53.512 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1196} 2019-12-19T22:00:53.757 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1197} 2019-12-19T22:00:53.978 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1198} 2019-12-19T22:00:54.195 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1199} 2019-12-19T22:00:54.417 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1200} 2019-12-19T22:00:54.660 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1201} 2019-12-19T22:00:54.900 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2019-12-19T22:00:55.124 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1202} 2019-12-19T22:00:55.333 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1203} 2019-12-19T22:00:55.551 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1204} 2019-12-19T22:00:57.141 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10102, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72"}, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2019-12-19T22:00:57.323 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:00:57 +0000 (0:00:25.872) 0:00:37.050 ***** 2019-12-19T22:00:57.354 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2019-12-19T22:00:57.396 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:00:57 +0000 (0:00:00.070) 0:00:37.120 ***** 2019-12-19T22:00:57.453 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2019-12-19T22:00:57.463 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "tr 2019-12-19T22:00:57.465 INFO:teuthology.task.ansible.out:ociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7 2019-12-19T22:00:57.466 INFO:teuthology.task.ansible.out:L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32 2019-12-19T22:00:57.468 INFO:teuthology.task.ansible.out:f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b 2019-12-19T22:00:57.469 INFO:teuthology.task.ansible.out:09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJy 2019-12-19T22:00:57.474 INFO:teuthology.task.ansible.out:w 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 2019-12-19T22:00:57.475 INFO:teuthology.task.ansible.out: 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf853 2019-12-19T22:00:57.476 INFO:teuthology.task.ansible.out:2237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36b 2019-12-19T22:00:57.478 INFO:teuthology.task.ansible.out:deb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a28 2019-12-19T22:00:57.493 INFO:teuthology.task.ansible.out:73481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c 2019-12-19T22:00:57.494 INFO:teuthology.task.ansible.out:4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72"}]}, "changed": false} 2019-12-19T22:00:57.555 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:00:57 +0000 (0:00:00.159) 0:00:37.280 ***** 2019-12-19T22:00:58.612 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* ok: [smithi050.front.sepia.ceph.com -> localhost] => {"after": "f4e10beea550ddcc5081090533acfa405cd36c43", "attempts": 1, "before": "f4e10beea550ddcc5081090533acfa405cd36c43", "changed": false, "remote_url_changed": false} 2019-12-19T22:00:58.665 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:00:58 +0000 (0:00:01.111) 0:00:38.392 ***** 2019-12-19T22:00:59.063 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-19T22:00:59.065 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2019-12-19T22:00:59.399 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2019-12-19T22:00:59.692 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2019-12-19T22:01:00.006 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCWy2i6Iv6IWLh53Z44O4fQ0ctxR8odCAWIZAaSQXAxxC++RS+95Zr+BZ5wJwsBOyP1G4AAhl+9uwnn3NmDDG7fKGexPoQrTZZ27KdJ3bHpZRq5LJf9byWFwz4rDsqIqkGjI9sUkfa6nV7ci2BdEkIgLupTT2uXUzTb/njOjI7Fc+cQ7ac4QfJ+yeIcqxeje/YYDF3068V4z1yynk9q2KRXYdERKQghaWDNJlbdBhn/fmsam6okOtUnsXjE88qGPd+LVHWfK0EfYvYXiAoOaJDK8d4EXnJ4RKJceQPBk8ravuQtKVwnRIr8WtmILHuoztthfwqb2WvZ5iMDt6v7oQZ alfredo@papaya.local", "key_options": null, "keyfile": "/home/adeza/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adeza", "validate_certs": true} 2019-12-19T22:01:00.328 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "va 2019-12-19T22:01:00.330 INFO:teuthology.task.ansible.out:lidate_certs": true} 2019-12-19T22:01:00.670 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2019-12-19T22:01:01.018 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZtt 2019-12-19T22:01:01.020 INFO:teuthology.task.ansible.out:Edz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2019-12-19T22:01:01.338 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2019-12-19T22:01:01.645 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2019-12-19T22:01:01.646 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:01.989 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uT 2019-12-19T22:01:01.991 INFO:teuthology.task.ansible.out:fMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2019-12-19T22:01:02.016 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:02.028 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:02.037 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:02.348 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2019-12-19T22:01:02.691 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+ 2019-12-19T22:01:02.738 INFO:teuthology.task.ansible.out:2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2019-12-19T22:01:03.010 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2019-12-19T22:01:03.327 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2019-12-19T22:01:03.638 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} 2019-12-19T22:01:03.968 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2019-12-19T22:01:04.277 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2019-12-19T22:01:04.578 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2019-12-19T22:01:04.889 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1 2019-12-19T22:01:04.891 INFO:teuthology.task.ansible.out:Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2019-12-19T22:01:05.229 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkR 2019-12-19T22:01:05.234 INFO:teuthology.task.ansible.out:hoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2019-12-19T22:01:05.534 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2019-12-19T22:01:05.847 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2019-12-19T22:01:06.178 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwm 2019-12-19T22:01:06.180 INFO:teuthology.task.ansible.out:ih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2019-12-19T22:01:06.492 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2019-12-19T22:01:06.808 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2019-12-19T22:01:07.136 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2019-12-19T22:01:07.441 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2019-12-19T22:01:07.761 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2019-12-19T22:01:08.072 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2 2019-12-19T22:01:08.074 INFO:teuthology.task.ansible.out:CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2019-12-19T22:01:08.386 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2019-12-19T22:01:08.692 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2019-12-19T22:01:09.019 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2019-12-19T22:01:09.367 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2019-12-19T22:01:09.665 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2019-12-19T22:01:09.980 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2019-12-19T22:01:10.320 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-12-19T22:01:10.634 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2019-12-19T22:01:10.946 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2019-12-19T22:01:11.261 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6 2019-12-19T22:01:11.262 INFO:teuthology.task.ansible.out:AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2019-12-19T22:01:11.564 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2Ruq 2019-12-19T22:01:11.566 INFO:teuthology.task.ansible.out:iZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2019-12-19T22:01:11.917 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2019-12-19T22:01:12.222 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2019-12-19T22:01:12.547 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2019-12-19T22:01:12.854 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options" 2019-12-19T22:01:12.856 INFO:teuthology.task.ansible.out:: null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-12-19T22:01:13.186 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+z 2019-12-19T22:01:13.192 INFO:teuthology.task.ansible.out:mfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbB 2019-12-19T22:01:13.194 INFO:teuthology.task.ansible.out:mS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2019-12-19T22:01:13.500 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2019-12-19T22:01:13.802 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2019-12-19T22:01:14.127 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2019-12-19T22:01:14.432 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2019-12-19T22:01:14.749 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2019-12-19T22:01:15.072 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2019-12-19T22:01:15.399 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2019-12-19T22:01:15.701 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2019-12-19T22:01:16.006 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user 2019-12-19T22:01:16.007 INFO:teuthology.task.ansible.out:": "gabrioux", "validate_certs": true} 2019-12-19T22:01:16.323 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2019-12-19T22:01:16.642 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2019-12-19T22:01:16.961 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS 2019-12-19T22:01:16.964 INFO:teuthology.task.ansible.out:33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2019-12-19T22:01:17.282 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2019-12-19T22:01:17.601 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2019-12-19T22:01:17.914 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2019-12-19T22:01:18.236 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-12-19T22:01:18.560 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2019-12-19T22:01:18.886 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2019-12-19T22:01:19.203 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2019-12-19T22:01:19.539 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2019-12-19T22:01:19.859 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2019-12-19T22:01:20.184 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2019-12-19T22:01:20.473 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2019-12-19T22:01:20.777 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2019-12-19T22:01:21.146 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2019-12-19T22:01:21.457 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2019-12-19T22:01:21.775 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2019-12-19T22:01:22.073 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2019-12-19T22:01:22.387 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2019-12-19T22:01:22.685 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2019-12-19T22:01:23.026 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2019-12-19T22:01:23.338 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2019-12-19T22:01:23.672 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2019-12-19T22:01:23.997 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2019-12-19T22:01:24.296 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2019-12-19T22:01:24.601 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2019-12-19T22:01:24.914 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2019-12-19T22:01:25.232 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.lo 2019-12-19T22:01:25.234 INFO:teuthology.task.ansible.out:caldomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2019-12-19T22:01:25.548 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfb 2019-12-19T22:01:25.554 INFO:teuthology.task.ansible.out:smXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2019-12-19T22:01:25.842 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz1UnJy64hXJKl1OsqRPlZ84m/fyHE8/Hqimy5s8sWcvRs2tL5oK30zFataqv1BC7r46+9t1eGUIRAuBg6QPuJnJCnPzS8yTVJ6DqSDGE2NAnpcMK5fSb+qgQ2adHFkjzZ4eKZbnDJMjYBtpUEp1Ve2ncdq5YCy6hGLIstkGq331ULBc/Lm3ZHBwy5I51S8eldkuP975otBYSPZaaN25QDncZzrW36zb3VwoGUAANEfHC1kLgTTFjx0bdsAGYCduXzyyXls8qSv9gbzcRzZZoH5B7tj8VDBoHszPnqGjGqwtWaelifYE/Svp+8fJKLlzRUM+XGNZoNcRl1/1XVhYV/ deepika@deepika", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2019-12-19T22:01:26.153 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2019-12-19T22:01:26.459 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2019-12-19T22:01:26.754 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2019-12-19T22:01:27.057 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2019-12-19T22:01:27.354 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2019-12-19T22:01:27.674 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2019-12-19T22:01:27.960 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2019-12-19T22:01:28.272 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2019-12-19T22:01:28.579 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2019-12-19T22:01:28.901 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2019-12-19T22:01:29.200 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2019-12-19T22:01:29.531 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2019-12-19T22:01:29.868 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2019-12-19T22:01:30.161 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_key 2019-12-19T22:01:30.163 INFO:teuthology.task.ansible.out:s", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-12-19T22:01:30.477 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2019-12-19T22:01:30.789 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2019-12-19T22:01:31.098 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2019-12-19T22:01:31.420 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2019-12-19T22:01:31.528 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:01:31 +0000 (0:00:32.863) 0:01:11.255 ***** 2019-12-19T22:01:31.585 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-19T22:01:31.586 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:31.599 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:31.611 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:31.633 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d2 2019-12-19T22:01:31.634 INFO:teuthology.task.ansible.out:49450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:31.644 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:31.665 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:31.963 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf59 2019-12-19T22:01:31.964 INFO:teuthology.task.ansible.out:2607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:32.273 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2019-12-19T22:01:32.584 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2019-12-19T22:01:32.883 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2019-12-19T22:01:32.894 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:32.903 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:32.914 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:32.927 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:32.958 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:32.976 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:32.981 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:32.992 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.003 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.014 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.025 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.026 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.041 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.064 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.070 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.081 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.092 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.104 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.118 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.141 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.151 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.164 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.175 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.186 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.197 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.209 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.221 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.242 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.248 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.254 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.265 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.266 INFO:teuthology.task.ansible.out: 2019-12-19T22:01:33.277 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.289 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.301 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.312 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.323 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.334 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.347 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.368 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.380 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.390 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.401 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.412 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.435 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.448 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.458 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.468 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.480 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.501 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.513 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.525 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.552 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.589 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.604 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.615 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.632 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.641 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.663 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.664 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.676 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.677 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.690 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.702 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.714 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.720 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.727 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.740 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.751 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.752 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.765 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.774 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.797 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.808 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.822 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.831 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.842 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.843 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.854 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.865 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.881 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.892 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.903 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:33.957 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:01:33 +0000 (0:00:02.429) 0:01:13.685 ***** 2019-12-19T22:01:33.991 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:34.025 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:01:34 +0000 (0:00:00.067) 0:01:13.752 ***** 2019-12-19T22:01:34.279 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-19T22:01:34.280 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2019-12-19T22:01:34.487 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2019-12-19T22:01:34.699 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2019-12-19T22:01:34.916 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2019-12-19T22:01:35.126 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2019-12-19T22:01:35.355 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2019-12-19T22:01:35.583 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2019-12-19T22:01:35.803 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2019-12-19T22:01:36.007 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2019-12-19T22:01:36.237 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2019-12-19T22:01:36.446 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2019-12-19T22:01:36.657 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2019-12-19T22:01:36.885 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2019-12-19T22:01:37.116 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2019-12-19T22:01:37.357 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2019-12-19T22:01:37.572 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2019-12-19T22:01:37.788 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2019-12-19T22:01:38.009 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2019-12-19T22:01:38.227 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2019-12-19T22:01:38.449 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2019-12-19T22:01:38.667 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2019-12-19T22:01:38.877 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2019-12-19T22:01:39.095 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2019-12-19T22:01:39.297 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2019-12-19T22:01:39.528 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2019-12-19T22:01:39.725 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2019-12-19T22:01:39.930 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2019-12-19T22:01:40.161 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2019-12-19T22:01:40.383 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2019-12-19T22:01:40.592 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2019-12-19T22:01:40.813 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2019-12-19T22:01:41.060 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2019-12-19T22:01:41.278 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2019-12-19T22:01:41.494 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2019-12-19T22:01:41.720 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2019-12-19T22:01:41.939 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2019-12-19T22:01:42.158 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2019-12-19T22:01:42.377 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2019-12-19T22:01:42.598 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2019-12-19T22:01:42.806 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2019-12-19T22:01:43.036 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2019-12-19T22:01:43.108 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:01:43 +0000 (0:00:09.082) 0:01:22.835 ***** 2019-12-19T22:01:43.672 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** changed: [smithi050.front.sepia.ceph.com] => {"changed": true, "checksum": "bcb7fb0987df16cc4ec0eb20567ca03f52e167d8", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "66384b595a953a298cfd60e4301d14e6", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1576792903.13-42663685948491/source", "state": "file", "uid": 0} 2019-12-19T22:01:43.715 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:01:43 +0000 (0:00:00.606) 0:01:23.442 ***** 2019-12-19T22:01:43.753 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2019-12-19T22:01:43.755 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => { "msg": "Host smithi050.front.sepia.ceph.com is running RedHat 8.0 (Ootpa)" } 2019-12-19T22:01:43.805 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:01:43 +0000 (0:00:00.090) 0:01:23.533 ***** 2019-12-19T22:01:43.843 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2019-12-19T22:01:43.844 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml) => {"ansible_facts": {"epel_repos": {"epel": {"enabled": "{{ enable_epel | ternary(1, 0) }}", "failovermethod": "priority", "gpgcheck": 0, "metalink": "https://mirrors.fedoraproject.org/metalink?repo=epel-$releasever&arch=$basearch&infra=$infra&content=$contentdir", "name": "Extra Packages for Enterprise Linux $releasever - $basearch"}}, "nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"], "rhsm_repos": ["rhel-8-for-x86_64-baseos-rpms", "rhel-8-for-x86_64-appstream-rpms"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"} 2019-12-19T22:01:43.882 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:01:43 +0000 (0:00:00.076) 0:01:23.609 ***** 2019-12-19T22:01:43.908 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2019-12-19T22:01:43.910 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:43.951 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:01:43 +0000 (0:00:00.068) 0:01:23.678 ***** 2019-12-19T22:01:44.238 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2019-12-19T22:01:44.239 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.074861", "end": "2019-12-19 22:01:44.215145", "rc": 0, "start": "2019-12-19 22:01:44.140284", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2019-12-19T22:01:44.276 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:01:44 +0000 (0:00:00.325) 0:01:24.003 ***** 2019-12-19T22:01:44.302 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2019-12-19T22:01:44.303 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:44.341 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:01:44 +0000 (0:00:00.064) 0:01:24.068 ***** 2019-12-19T22:01:44.367 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2019-12-19T22:01:44.368 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:44.406 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:01:44 +0000 (0:00:00.065) 0:01:24.133 ***** 2019-12-19T22:01:44.433 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2019-12-19T22:01:44.435 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:44.473 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:01:44 +0000 (0:00:00.066) 0:01:24.200 ***** 2019-12-19T22:01:44.499 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2019-12-19T22:01:44.501 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:44.535 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:01:44 +0000 (0:00:00.062) 0:01:24.262 ***** 2019-12-19T22:01:44.561 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2019-12-19T22:01:44.562 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:44.598 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:01:44 +0000 (0:00:00.062) 0:01:24.325 ***** 2019-12-19T22:01:44.635 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** ok: [smithi050.front.sepia.ceph.com] => {"ansible_facts": {"entitlements_path": "/etc/ansible/secrets/entitlements.yml"}, "changed": false} 2019-12-19T22:01:44.673 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:01:44 +0000 (0:00:00.074) 0:01:24.400 ***** 2019-12-19T22:01:44.730 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2019-12-19T22:01:44.731 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [smithi050.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-19T22:01:44.772 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:01:44 +0000 (0:00:00.099) 0:01:24.499 ***** 2019-12-19T22:01:44.833 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** ok: [smithi050.front.sepia.ceph.com] => {"ansible_facts": {"have_entitlements": true}, "changed": false} 2019-12-19T22:01:44.873 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:01:44 +0000 (0:00:00.101) 0:01:24.600 ***** 2019-12-19T22:01:46.097 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed /root/.ansible/tmp/ansible-moduletmp-1576792905.9873784-329s81n3/katello-ca-consumer-latest.noarch64__dtt0.rpm"]} 2019-12-19T22:01:46.137 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:01:46 +0000 (0:00:01.263) 0:01:25.864 ***** 2019-12-19T22:01:47.144 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2019-12-19T22:01:47.145 INFO:teuthology.task.ansible.out:fatal: [smithi050.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ...ignoring 2019-12-19T22:01:47.198 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:01:47 +0000 (0:00:01.057) 0:01:26.922 ***** 2019-12-19T22:01:47.248 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** ok: [smithi050.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": false}, "changed": false} 2019-12-19T22:01:47.315 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:01:47 +0000 (0:00:00.115) 0:01:27.037 ***** 2019-12-19T22:01:55.684 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2019-12-19T22:01:55.686 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => {"attempts": 1, "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2019-12-19T22:01:55.725 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:01:55 +0000 (0:00:08.414) 0:01:35.452 ***** 2019-12-19T22:01:55.762 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2019-12-19T22:01:55.763 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": true}, "changed": false} 2019-12-19T22:01:55.807 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:01:55 +0000 (0:00:00.082) 0:01:35.534 ***** 2019-12-19T22:01:56.752 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2019-12-19T22:01:56.753 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager release --list | grep -E '[0-9]'", "delta": "0:00:00.709255", "end": "2019-12-19 22:01:56.714297", "failed_when_result": false, "rc": 0, "start": "2019-12-19 22:01:56.005042", "stderr": "", "stderr_lines": [], "stdout": "7.4\n7.5\n7.6\n7.7\n7Server\n8\n8.0\n8.1", "stdout_lines": ["7.4", "7.5", "7.6", "7.7", "7Server", "8", "8.0", "8.1"]} 2019-12-19T22:01:56.791 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:01:56 +0000 (0:00:00.983) 0:01:36.518 ***** 2019-12-19T22:01:56.829 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2019-12-19T22:01:56.832 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:56.871 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:01:56 +0000 (0:00:00.078) 0:01:36.596 ***** 2019-12-19T22:01:56.906 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2019-12-19T22:01:56.907 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:56.952 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:01:56 +0000 (0:00:00.077) 0:01:36.674 ***** 2019-12-19T22:01:56.973 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2019-12-19T22:01:56.975 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-19T22:01:57.023 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:01:57 +0000 (0:00:00.075) 0:01:36.750 ***** 2019-12-19T22:01:57.063 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2019-12-19T22:01:57.065 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:01:57.120 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:01:57 +0000 (0:00:00.096) 0:01:36.847 ***** 2019-12-19T22:02:08.215 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager repos --list | grep -B4 'Enabled:.*1' | grep 'Repo ID:' | sed -e 's/Repo ID:\\s*\\(.*\\)/\\1/' | sort", "delta": "0:00:10.856186", "end": "2019-12-19 22:02:08.177325", "rc": 0, "start": "2019-12-19 22:01:57.321139", "stderr": "", "stderr_lines": [], "stdout": "rhel-8-for-x86_64-appstream-rpms\nrhel-8-for-x86_64-baseos-rpms", "stdout_lines": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]} 2019-12-19T22:02:08.264 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:02:08 +0000 (0:00:11.142) 0:01:47.990 ***** 2019-12-19T22:02:08.316 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ ok: [smithi050.front.sepia.ceph.com] => {"ansible_facts": {"repo_list": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]}, "changed": false} 2019-12-19T22:02:08.360 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:02:08 +0000 (0:00:00.097) 0:01:48.087 ***** 2019-12-19T22:02:08.410 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:02:08.448 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:02:08 +0000 (0:00:00.087) 0:01:48.175 ***** 2019-12-19T22:02:08.486 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** ok: [smithi050.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": false}, "changed": false} 2019-12-19T22:02:08.532 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:02:08 +0000 (0:00:00.083) 0:01:48.259 ***** 2019-12-19T22:02:08.572 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2019-12-19T22:02:08.574 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": true}, "changed": false} 2019-12-19T22:02:08.611 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:02:08 +0000 (0:00:00.078) 0:01:48.338 ***** 2019-12-19T22:02:20.466 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2019-12-19T22:02:20.468 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2019-12-19T22:02:20.505 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:02:20 +0000 (0:00:11.894) 0:02:00.233 ***** 2019-12-19T22:02:25.566 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2019-12-19T22:02:25.568 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item=rhel-8-for-x86_64-baseos-rpms) => {"ansible_loop_var": "item", "changed": true, "cmd": ["subscription-manager", "repos", "--enable", "rhel-8-for-x86_64-baseos-rpms"], "delta": "0:00:04.806728", "end": "2019-12-19 22:02:25.541342", "item": "rhel-8-for-x86_64-baseos-rpms", "rc": 0, "start": "2019-12-19 22:02:20.734614", "stderr": "", "stderr_lines": [], "stdout": "Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.", "stdout_lines": ["Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system."]} 2019-12-19T22:02:31.552 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item=rhel-8-for-x86_64-appstream-rpms) => {"ansible_loop_var": "item", "changed": true, "cmd": ["subscription-manager", "repos", "--enable", "rhel-8-for-x86_64-appstream-rpms"], "delta": "0:00:05.767163", "end": "2019-12-19 22:02:31.520988", "item": "rhel-8-for-x86_64-appstream-rpms", "rc": 0, "start": "2019-12-19 22:02:25.753825", "stderr": "", "stderr_lines": [], "stdout": "Internal Server Error): Required lock is already taken by other running tasks.\nPlease inspect their state, fix their errors and resume them.\n\nRequired lock: update\nConflicts with tasks:\n https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/500cf098 ada9 4c29 bea0 50dc8c64ce58\n\nRepository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system.", "stdout_lines": ["Internal Server Error): Required lock is already taken by other running tasks.", "Please inspect their state, fix their errors and resume them.", "", "Required lock: update", "Conflicts with tasks:", " https://satellite.front.sepia.ceph.com/foreman_tasks/tasks/500cf098 ada9 4c29 bea0 50dc8c64ce58", "", "Repository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system."]} 2019-12-19T22:02:31.594 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:02:31 +0000 (0:00:11.088) 0:02:11.321 ***** 2019-12-19T22:02:32.182 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2019-12-19T22:02:32.184 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "path": "/etc/yum.repos.d/cd.repo", "state": "absent"} 2019-12-19T22:02:32.222 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:02:32 +0000 (0:00:00.627) 0:02:11.949 ***** 2019-12-19T22:02:32.445 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** ok: [smithi050.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-19T22:02:32.493 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:02:32 +0000 (0:00:00.271) 0:02:12.220 ***** 2019-12-19T22:02:33.073 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2019-12-19T22:02:33.078 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'metalink': u'https://mirrors.fedoraproject.org/metalink?repo=epel-$releasever&arch=$basearch&infra=$infra&content=$contentdir', u'enabled': u'1', u'name': u'Extra Packages for Enterprise Linux $releasever - $basearch', u'failovermethod': u'priority'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "e6ba489657e79a66ebaff7f2cc203b7a42394494", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "metalink": "https://mirrors.fedoraproject.org/metalink?repo=epel-$releasever&arch=$basearch&infra=$infra&content=$contentdir", "name": "Extra Packages for Enterprise Linux $releasever - $basearch"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 331, "state": "file", "uid": 0} 2019-12-19T22:02:33.133 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:02:33 +0000 (0:00:00.640) 0:02:12.860 ***** 2019-12-19T22:02:33.772 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* changed: [smithi050.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "md5sum": "c0b17108eae19ce4e019023f4d971436", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1576792953.17-251660487213133/source", "state": "file", "uid": 0} 2019-12-19T22:02:34.481 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "md5sum": "8ea2607820b97348115878813225ac00", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1576792953.78-113367776452296/source", "state": "file", "uid": 0} 2019-12-19T22:02:34.525 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:02:34 +0000 (0:00:01.391) 0:02:14.252 ***** 2019-12-19T22:02:35.061 INFO:teuthology.task.ansible.out: TASK [common : Temporarily comment mirrorlist so we can update yum cache] ****** 2019-12-19T22:02:35.063 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'metalink': u'https://mirrors.fedoraproject.org/metalink?repo=epel-$releasever&arch=$basearch&infra=$infra&content=$contentdir', u'enabled': u'1', u'name': u'Extra Packages for Enterprise Linux $releasever - $basearch', u'failovermethod': u'priority'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "metalink": "https://mirrors.fedoraproject.org/metalink?repo=epel-$releasever&arch=$basearch&infra=$infra&content=$contentdir", "name": "Extra Packages for Enterprise Linux $releasever - $basearch"}}, "msg": "1 replacements made"} 2019-12-19T22:02:35.104 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:02:35 +0000 (0:00:00.579) 0:02:14.831 ***** 2019-12-19T22:02:40.771 INFO:teuthology.task.ansible.out: TASK [common : Update yum cache] *********************************************** [WARNING]: Consider using the file module with state=absent rather than running 'rm'. If you need to use command because file is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi050.front.sepia.ceph.com] => {"changed": true, "cmd": "rm -rf /var/cache/yum/*; yum clean all; yum makecache", "delta": "0:00:05.443339", "end": "2019-12-19 22:02:40.740693", "rc": 0, "start": "2019-12-19 22:02:35.297354", "stderr": "Cannot find a valid baseurl for repo: epel, ignoring this repo.", "stderr_lines": ["Cannot find a valid baseurl for repo: epel, ignoring this repo."], "stdout": "Updating Subscription Management repositories.\n195 files removed\nUpdating Subscription Management repositories.\nRed Hat Enterprise Linux 8 for x86_64 - AppStre 43 MB/s | 9.4 MB 00:00 \nRed Hat Enterprise Linux 8 for x86_64 - BaseOS 37 MB/s | 8.1 MB 00:00 \nLast metadata expiration check: 0:00:01 ago on Thu 19 Dec 2019 10:02:38 PM UTC.\nMetadata cache created.", "stdout_lines": ["Updating Subscription Management repositories.", "195 files removed", "Updating Subscription Management repositories.", "Red Hat Enterprise Linux 8 for x86_64 - AppStre 43 MB/s | 9.4 MB 00:00 ", "Red Hat Enterprise Linux 8 for x86_64 - BaseOS 37 MB/s | 8.1 MB 00:00 ", "Last metadata expiration check: 0:00:01 ago on Thu 19 Dec 2019 10:02:38 PM UTC.", "Metadata cache created."]} 2019-12-19T22:02:40.816 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:02:40 +0000 (0:00:05.712) 0:02:20.544 ***** 2019-12-19T22:02:41.079 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* 2019-12-19T22:02:41.081 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'metalink': u'https://mirrors.fedoraproject.org/metalink?repo=epel-$releasever&arch=$basearch&infra=$infra&content=$contentdir', u'enabled': u'1', u'name': u'Extra Packages for Enterprise Linux $releasever - $basearch', u'failovermethod': u'priority'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "metalink": "https://mirrors.fedoraproject.org/metalink?repo=epel-$releasever&arch=$basearch&infra=$infra&content=$contentdir", "name": "Extra Packages for Enterprise Linux $releasever - $basearch"}}, "msg": "1 replacements made"} 2019-12-19T22:02:41.131 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:02:41 +0000 (0:00:00.311) 0:02:20.855 ***** 2019-12-19T22:02:41.165 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-12-19T22:02:41.166 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:02:41.224 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:02:41 +0000 (0:00:00.095) 0:02:20.950 ***** 2019-12-19T22:02:41.265 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:02:41.332 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:02:41 +0000 (0:00:00.103) 0:02:21.054 ***** 2019-12-19T22:02:41.360 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:02:41.412 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:02:41 +0000 (0:00:00.085) 0:02:21.139 ***** 2019-12-19T22:02:41.453 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-12-19T22:02:41.455 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:02:41.500 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:02:41 +0000 (0:00:00.087) 0:02:21.227 ***** 2019-12-19T22:02:41.539 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:02:41.578 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:02:41 +0000 (0:00:00.078) 0:02:21.305 ***** 2019-12-19T22:02:41.604 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2019-12-19T22:02:41.606 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:02:41.646 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:02:41 +0000 (0:00:00.068) 0:02:21.373 ***** 2019-12-19T22:02:41.695 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:02:41.729 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:02:41 +0000 (0:00:00.083) 0:02:21.456 ***** 2019-12-19T22:02:41.756 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:02:41.799 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:02:41 +0000 (0:00:00.069) 0:02:21.526 ***** 2019-12-19T22:02:42.523 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** changed: [smithi050.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.511461", "end": "2019-12-19 22:02:42.500338", "rc": 0, "start": "2019-12-19 22:02:41.988877", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-19T22:02:42.565 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:02:42 +0000 (0:00:00.764) 0:02:22.291 ***** 2019-12-19T22:02:46.968 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2019-12-19T22:02:47.008 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:02:47 +0000 (0:00:04.441) 0:02:26.733 ***** 2019-12-19T22:02:47.043 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2019-12-19T22:02:47.045 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:02:47.083 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:02:47 +0000 (0:00:00.076) 0:02:26.809 ***** 2019-12-19T22:02:47.132 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:02:47.176 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:02:47 +0000 (0:00:00.094) 0:02:26.904 ***** 2019-12-19T22:02:47.204 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2019-12-19T22:02:47.207 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:02:47.255 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:02:47 +0000 (0:00:00.077) 0:02:26.981 ***** 2019-12-19T22:02:47.281 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2019-12-19T22:02:47.282 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:02:47.348 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:02:47 +0000 (0:00:00.086) 0:02:27.068 ***** 2019-12-19T22:02:47.894 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2019-12-19T22:02:47.896 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2019-12-19T22:02:47.965 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:02:47 +0000 (0:00:00.624) 0:02:27.693 ***** 2019-12-19T22:02:49.917 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} 2019-12-19T22:02:49.963 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:02:49 +0000 (0:00:01.996) 0:02:29.689 ***** 2019-12-19T22:02:50.723 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-12-19T22:02:50.723 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": true, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "md5sum": "da0dc6d43b293333920cda2d1fc220e2", "mode": "0755", "owner": "root", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1576792969.99-147755264336532/source", "state": "file", "uid": 0} 2019-12-19T22:02:51.459 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": true, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "md5sum": "5e1d5cbeb339bbe2906752233e88486d", "mode": "0755", "owner": "root", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1576792970.72-75812131240988/source", "state": "file", "uid": 0} 2019-12-19T22:02:52.079 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": true, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "md5sum": "f8f4b724d9a4fc98a48d3ba3cb2748e2", "mode": "0755", "owner": "root", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1576792971.47-120539519103443/source", "state": "file", "uid": 0} 2019-12-19T22:02:52.135 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:02:52 +0000 (0:00:02.172) 0:02:31.862 ***** 2019-12-19T22:02:52.355 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-12-19T22:02:52.401 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:02:52 +0000 (0:00:00.260) 0:02:32.122 ***** 2019-12-19T22:02:53.025 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2019-12-19T22:02:53.026 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": true, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "md5sum": "a1185825c55c0301955d1c6f48afa459", "mode": "0755", "owner": "root", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1576792972.43-216353213574393/source", "state": "file", "uid": 0} 2019-12-19T22:02:53.603 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": true, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "md5sum": "2ff1d0b7420a46c24916a3f7cba75004", "mode": "0755", "owner": "root", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1576792973.02-145353901183738/source", "state": "file", "uid": 0} 2019-12-19T22:02:54.228 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": true, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "md5sum": "a826600dbfe6a128fb60ddc413ef1069", "mode": "0755", "owner": "root", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1576792973.61-40543436089471/source", "state": "file", "uid": 0} 2019-12-19T22:02:54.281 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:02:54 +0000 (0:00:01.886) 0:02:34.009 ***** 2019-12-19T22:02:54.323 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:02:54.371 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:02:54 +0000 (0:00:00.089) 0:02:34.098 ***** 2019-12-19T22:02:54.410 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2019-12-19T22:02:54.413 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2019-12-19T22:02:54.450 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:02:54 +0000 (0:00:00.078) 0:02:34.176 ***** 2019-12-19T22:02:54.685 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* changed: [smithi050.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2019-12-19T22:02:54.729 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:02:54 +0000 (0:00:00.271) 0:02:34.448 ***** 2019-12-19T22:02:54.782 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** skipping: [smithi050.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-19T22:02:54.811 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-19T22:02:54.825 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-19T22:02:54.847 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-19T22:02:54.890 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:02:54 +0000 (0:00:00.169) 0:02:34.618 ***** 2019-12-19T22:03:03.988 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2019-12-19T22:03:03.989 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load", "Installed: nagios-plugins-2.2.2-2.20190926git1b8ad57.el8.x86_64", "Installed: nagios-plugins-load-2.2.2-2.20190926git1b8ad57.el8.x86_64", "Installed: nrpe-3.2.1-9.el8.x86_64", "Installed: nagios-common-4.4.5-1.el8.x86_64"]} 2019-12-19T22:03:04.044 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:04 +0000 (0:00:09.154) 0:02:43.772 ***** 2019-12-19T22:03:04.081 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** 2019-12-19T22:03:04.082 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:03:04.120 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:04 +0000 (0:00:00.074) 0:02:43.847 ***** 2019-12-19T22:03:04.735 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2019-12-19T22:03:04.736 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => {"changed": true, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "md5sum": "acdfbe59732074480b7f015fa152a14e", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1576792984.14-5245965084388/source", "state": "file", "uid": 0} 2019-12-19T22:03:04.780 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:04 +0000 (0:00:00.660) 0:02:44.507 ***** 2019-12-19T22:03:05.362 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* changed: [smithi050.front.sepia.ceph.com] => {"changed": true, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "md5sum": "1f0ee88f0225fe8e005cd4f9fbc5e2d9", "mode": "0755", "owner": "root", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1576792984.81-172735797533772/source", "state": "file", "uid": 0} 2019-12-19T22:03:05.407 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:05 +0000 (0:00:00.627) 0:02:45.134 ***** 2019-12-19T22:03:05.445 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2019-12-19T22:03:05.447 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:03:05.491 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:05 +0000 (0:00:00.083) 0:02:45.218 ***** 2019-12-19T22:03:05.735 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* changed: [smithi050.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2019-12-19T22:03:05.767 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:05 +0000 (0:00:00.275) 0:02:45.494 ***** 2019-12-19T22:03:06.032 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2019-12-19T22:03:06.034 INFO:teuthology.task.ansible.out:fatal: [smithi050.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2019-12-19T22:03:06.069 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:06 +0000 (0:00:00.302) 0:02:45.796 ***** 2019-12-19T22:03:06.106 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:03:06.156 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:06 +0000 (0:00:00.086) 0:02:45.882 ***** 2019-12-19T22:03:06.816 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2019-12-19T22:03:06.817 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => {"changed": true, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "md5sum": "a2f2d08aa8aa3493038c91c0fd4b7279", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1576792986.18-89452443249005/source", "state": "file", "uid": 0} 2019-12-19T22:03:06.874 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:06 +0000 (0:00:00.719) 0:02:46.601 ***** 2019-12-19T22:03:07.888 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** changed: [smithi050.front.sepia.ceph.com] => {"changed": true, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "local-fs.target systemd-journald.socket -.mount network.target system.slice var-run.mount sysinit.target systemd-tmpfiles-setup.service nss-lookup.target tmp.mount basic.target time-sync.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "getty@tty1.service xdm.service plymouth-quit.service shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.o 2019-12-19T22:03:07.892 INFO:teuthology.task.ansible.out:rg/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "[not set]", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft 2019-12-19T22:03:07.894 INFO:teuthology.task.ansible.out:": "1024", "LimitNPROC": "127487", "LimitNPROCSoft": "127487", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127487", "LimitSIGPENDINGSoft": "127487", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/run/nrpe /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimi 2019-12-19T22:03:07.896 INFO:teuthology.task.ansible.out:tBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "disabled", "User": "nrpe", "UtmpMode": "init", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-12-19T22:03:07.928 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:07 +0000 (0:00:01.052) 0:02:47.654 ***** 2019-12-19T22:03:08.148 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* changed: [smithi050.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001707", "end": "2019-12-19 22:03:08.119576", "rc": 0, "start": "2019-12-19 22:03:08.117869", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2019-12-19T22:03:08.189 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:08 +0000 (0:00:00.261) 0:02:47.916 ***** 2019-12-19T22:03:09.975 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2019-12-19T22:03:09.976 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2019-12-19T22:03:10.039 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:10 +0000 (0:00:01.848) 0:02:49.765 ***** 2019-12-19T22:03:11.843 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2019-12-19T22:03:11.844 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2019-12-19T22:03:11.891 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:11 +0000 (0:00:01.853) 0:02:51.618 ***** 2019-12-19T22:03:14.092 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** changed: [smithi050.front.sepia.ceph.com] => {"changed": true, "name": "nagios_run_sudo", "persistent": true, "state": true} 2019-12-19T22:03:14.133 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:14 +0000 (0:00:02.242) 0:02:53.861 ***** 2019-12-19T22:03:14.519 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2019-12-19T22:03:14.523 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:00.165458", "end": "2019-12-19 22:03:14.489652", "failed_when_result": false, "msg": "non-zero return code", "rc": 1, "start": "2019-12-19 22:03:14.324194", "stderr": "libsemanage.semanage_direct_remove_key: Unable to remove module nrpe at priority 400. (No such file or directory).\nsemodule: Failed!", "stderr_lines": ["libsemanage.semanage_direct_remove_key: Unable to remove module nrpe at priority 400. (No such file or directory).", "semodule: Failed!"], "stdout": "", "stdout_lines": []} 2019-12-19T22:03:14.568 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:14 +0000 (0:00:00.434) 0:02:54.295 ***** 2019-12-19T22:03:15.161 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** changed: [smithi050.front.sepia.ceph.com] => {"changed": true, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "md5sum": "286c682fc73965c17876891a4581da3e", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1576792994.59-93827516102790/source", "state": "file", "uid": 0} 2019-12-19T22:03:15.212 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:15 +0000 (0:00:00.638) 0:02:54.933 ***** 2019-12-19T22:03:15.433 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2019-12-19T22:03:15.434 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.010541", "end": "2019-12-19 22:03:15.402877", "rc": 0, "start": "2019-12-19 22:03:15.392336", "stderr": "", "stderr_lines": [], "stdout": "checkmodule: loading policy configuration from /tmp/nrpe.te\ncheckmodule: policy configuration loaded\ncheckmodule: writing binary representation (version 19) to /tmp/nrpe.mod", "stdout_lines": ["checkmodule: loading policy configuration from /tmp/nrpe.te", "checkmodule: policy configuration loaded", "checkmodule: writing binary representation (version 19) to /tmp/nrpe.mod"]} 2019-12-19T22:03:15.478 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:15 +0000 (0:00:00.271) 0:02:55.205 ***** 2019-12-19T22:03:15.697 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** changed: [smithi050.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.008124", "end": "2019-12-19 22:03:15.675114", "rc": 0, "start": "2019-12-19 22:03:15.666990", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-19T22:03:15.748 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:15 +0000 (0:00:00.266) 0:02:55.472 ***** 2019-12-19T22:03:32.499 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2019-12-19T22:03:32.500 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.537392", "end": "2019-12-19 22:03:32.472696", "rc": 0, "start": "2019-12-19 22:03:15.935304", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-19T22:03:32.538 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:32 +0000 (0:00:16.792) 0:03:12.265 ***** 2019-12-19T22:03:32.760 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2019-12-19T22:03:32.803 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:32 +0000 (0:00:00.265) 0:03:12.530 ***** 2019-12-19T22:03:32.848 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** ok: [smithi050.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2019-12-19T22:03:32.884 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:32 +0000 (0:00:00.080) 0:03:12.611 ***** 2019-12-19T22:03:32.935 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2019-12-19T22:03:32.937 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-12-19T22:03:32.989 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:32 +0000 (0:00:00.105) 0:03:12.717 ***** 2019-12-19T22:03:33.028 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2019-12-19T22:03:33.029 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "copr_repos": ["ktdreyer/ceph-el8"], "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["@core", "@base", "dnf-utils", "git-all", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "podman", "libev-devel", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "libacl-devel", "dbench", "autoconf"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"} 2019-12-19T22:03:33.082 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:33 +0000 (0:00:00.092) 0:03:12.809 ***** 2019-12-19T22:03:33.130 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2019-12-19T22:03:33.131 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-12-19T22:03:33.181 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:33 +0000 (0:00:00.098) 0:03:12.908 ***** 2019-12-19T22:03:33.399 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2019-12-19T22:03:33.400 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-12-19T22:03:33.437 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:33 +0000 (0:00:00.255) 0:03:13.164 ***** 2019-12-19T22:03:33.661 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2019-12-19T22:03:33.662 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "gid": 1205, "name": "ubuntu", "state": "present", "system": false} 2019-12-19T22:03:33.739 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:33 +0000 (0:00:00.302) 0:03:13.466 ***** 2019-12-19T22:03:33.768 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2019-12-19T22:03:33.769 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:03:33.812 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:33 +0000 (0:00:00.072) 0:03:13.539 ***** 2019-12-19T22:03:33.840 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:03:33.880 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:33 +0000 (0:00:00.066) 0:03:13.605 ***** 2019-12-19T22:03:34.104 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2019-12-19T22:03:34.106 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2019-12-19T22:03:34.161 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:34 +0000 (0:00:00.283) 0:03:13.889 ***** 2019-12-19T22:03:34.819 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2019-12-19T22:03:34.822 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2019-12-19T22:03:34.881 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:34 +0000 (0:00:00.719) 0:03:14.608 ***** 2019-12-19T22:03:34.936 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* ok: [smithi050.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi050"}, "changed": false} 2019-12-19T22:03:34.976 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:34 +0000 (0:00:00.094) 0:03:14.703 ***** 2019-12-19T22:03:36.007 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2019-12-19T22:03:36.009 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi050", "ansible_hostname": "smithi050", "ansible_nodename": "smithi050"}, "changed": false, "name": "smithi050"} 2019-12-19T22:03:36.058 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:36 +0000 (0:00:01.082) 0:03:15.785 ***** 2019-12-19T22:03:36.610 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2019-12-19T22:03:36.612 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2019-12-19T22:03:36.660 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:36 +0000 (0:00:00.592) 0:03:16.378 ***** 2019-12-19T22:03:37.184 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2019-12-19T22:03:37.186 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2019-12-19T22:03:37.225 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:37 +0000 (0:00:00.573) 0:03:16.952 ***** 2019-12-19T22:03:37.920 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2019-12-19T22:03:37.925 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2019-12-19T22:03:37.958 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:37 +0000 (0:00:00.732) 0:03:17.685 ***** 2019-12-19T22:03:38.489 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2019-12-19T22:03:38.531 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:38 +0000 (0:00:00.572) 0:03:18.257 ***** 2019-12-19T22:03:38.751 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-12-19T22:03:38.753 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2019-12-19T22:03:38.800 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:38 +0000 (0:00:00.269) 0:03:18.527 ***** 2019-12-19T22:03:39.019 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2019-12-19T22:03:39.063 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:39 +0000 (0:00:00.257) 0:03:18.785 ***** 2019-12-19T22:03:39.307 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* ok: [smithi050.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1205, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2019-12-19T22:03:39.383 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:39 +0000 (0:00:00.322) 0:03:19.107 ***** 2019-12-19T22:03:39.934 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-12-19T22:03:39.936 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2019-12-19T22:03:39.977 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:39 +0000 (0:00:00.597) 0:03:19.704 ***** 2019-12-19T22:03:40.509 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-12-19T22:03:40.510 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2019-12-19T22:03:40.562 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:40 +0000 (0:00:00.584) 0:03:20.289 ***** 2019-12-19T22:03:42.317 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ [WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi050.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.525931", "end": "2019-12-19 22:03:42.289096", "rc": 0, "start": "2019-12-19 22:03:40.763165", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-19T22:03:42.371 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:42 +0000 (0:00:01.809) 0:03:22.098 ***** 2019-12-19T22:03:43.014 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2019-12-19T22:03:43.020 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": true, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "md5sum": "fed359af26a9f925305897bc0401b3aa", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1576793022.41-12955976447076/source", "state": "file", "uid": 0} 2019-12-19T22:03:43.067 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:43 +0000 (0:00:00.695) 0:03:22.794 ***** 2019-12-19T22:03:43.095 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-12-19T22:03:43.141 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:43 +0000 (0:00:00.072) 0:03:22.867 ***** 2019-12-19T22:03:44.472 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2019-12-19T22:03:44.473 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item=ktdreyer/ceph-el8) => {"ansible_loop_var": "item", "changed": true, "cmd": ["dnf", "-y", "copr", "enable", "ktdreyer/ceph-el8"], "delta": "0:00:01.099500", "end": "2019-12-19 22:03:44.438713", "item": "ktdreyer/ceph-el8", "rc": 0, "start": "2019-12-19 22:03:43.339213", "stderr": "", "stderr_lines": [], "stdout": "Updating Subscription Management repositories.\nRepository successfully enabled.", "stdout_lines": ["Updating Subscription Management repositories.", "Repository successfully enabled."], "warnings": ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]} 2019-12-19T22:03:44.475 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2019-12-19T22:03:44.517 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:44 +0000 (0:00:01.377) 0:03:24.244 ***** 2019-12-19T22:03:44.558 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:03:44.626 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:44 +0000 (0:00:00.108) 0:03:24.353 ***** 2019-12-19T22:03:44.663 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2019-12-19T22:03:44.671 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-12-19T22:03:44.677 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-12-19T22:03:44.730 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:44 +0000 (0:00:00.098) 0:03:24.452 ***** 2019-12-19T22:03:45.762 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2019-12-19T22:03:45.762 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the yum module rather than running 'yum'. If you need to use command because yum is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2019-12-19T22:03:45.764 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => {"changed": true, "cmd": "yum clean all", "delta": "0:00:00.816489", "end": "2019-12-19 22:03:45.736528", "rc": 0, "start": "2019-12-19 22:03:44.920039", "stderr": "", "stderr_lines": [], "stdout": "Updating Subscription Management repositories.\n31 files removed", "stdout_lines": ["Updating Subscription Management repositories.", "31 files removed"]} 2019-12-19T22:03:45.810 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:45 +0000 (0:00:01.084) 0:03:25.536 ***** 2019-12-19T22:03:45.836 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-19T22:03:45.838 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:03:45.896 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:45 +0000 (0:00:00.086) 0:03:25.623 ***** 2019-12-19T22:03:45.940 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2019-12-19T22:03:45.942 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:03:45.992 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:45 +0000 (0:00:00.088) 0:03:25.712 ***** 2019-12-19T22:03:46.025 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2019-12-19T22:03:46.027 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:03:46.064 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:46 +0000 (0:00:00.080) 0:03:25.792 ***** 2019-12-19T22:03:46.303 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2019-12-19T22:03:46.303 INFO:teuthology.task.ansible.out:fatal: [smithi050.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.006847", "end": "2019-12-19 22:03:46.275223", "msg": "non-zero return code", "rc": 1, "start": "2019-12-19 22:03:46.268376", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} 2019-12-19T22:03:46.304 INFO:teuthology.task.ansible.out:...ignoring 2019-12-19T22:03:46.374 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:46 +0000 (0:00:00.309) 0:03:26.101 ***** 2019-12-19T22:03:46.403 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2019-12-19T22:03:46.405 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:03:46.445 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:46 +0000 (0:00:00.071) 0:03:26.173 ***** 2019-12-19T22:03:54.627 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-12-19T22:03:54.634 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2019-12-19T22:03:54.688 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:03:54 +0000 (0:00:08.242) 0:03:34.415 ***** 2019-12-19T22:03:59.990 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-12-19T22:03:59.994 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: hdparm-9.54-2.el8.x86_64", "Removed: tuned-2.10.0-15.el8.noarch"]} 2019-12-19T22:04:00.029 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:00 +0000 (0:00:05.341) 0:03:39.757 ***** 2019-12-19T22:04:00.030 INFO:teuthology.task.ansible.out: 2019-12-19T22:04:20.056 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* changed: [smithi050.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Group core installed.", "Group base installed.", "Installed: dnf-utils", "Installed: git-all", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: podman", "Installed: libev-devel", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: libacl-devel", "Installed: dbench", "Installed: autoconf", "Installed: glibc-devel-2.28-42.el8_0.1.x86_64", "Installed: python3-virtualenv-15.1.0-18.module+el8.0.0+2966+d39a1df3.noarch", "Installed: libattr-devel-2.4.48-3.el8.x86_64", "Installed: python-rpm-macros-3-37.el8.noarch", "Installed: hdparm-9.54-2.el8.x86_64", "Installed: tuned-2.10.0-15.el8.noarch", "Installed: annobin-8.64-1.el8.x86_64", "Installed: kernel-headers-4.18.0-80.11.2.el8_0.x86_64", "Installed: libxcrypt-devel-4.1.1-4.el8.x86_64", "Installed: libacl-devel-2.2.53-1.el8.x86_64", "Installed: qemu-img-15:2.12.0-65.module+el8.0.0+4084+cceb9f44.5.x86_64", "Installed: libusal-1.1.11-39.el8.x86_64", "Installed: python3-nose-1.3.7-30.module+el8.0.0+2966+d39a1df3.noarch", "Installed: cpp-8.2.1-3.5.el8.x86_64", "Installed: isl-0.16.1-6.el8.x86_64", "Installed: autoconf-2.69-27.el8.noarch", "Installed: python3-rpm-generators-5-4.el8.noarch", "Installed: gcc-8.2.1-3.5.el8.x86_64", "Installed: python36-devel-3.6.8-2.module+el8.0.0+2975+e0f02136.x86_64", "Installed: libmpc-1.0.2-9.el8.x86_64", "Installed: genisoimage-1.1.11-39.e 2019-12-19T22:04:20.058 INFO:teuthology.task.ansible.out:l8.x86_64", "Installed: dbench-4.0-20.el8.x86_64", "Installed: glibc-headers-2.28-42.el8_0.1.x86_64", "Installed: platform-python-devel-3.6.8-1.el8.x86_64"]} 2019-12-19T22:04:20.109 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:20 +0000 (0:00:20.080) 0:03:59.837 ***** 2019-12-19T22:04:20.146 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2019-12-19T22:04:20.148 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:20.198 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:20 +0000 (0:00:00.088) 0:03:59.925 ***** 2019-12-19T22:04:22.095 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-12-19T22:04:22.096 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2019-12-19T22:04:22.163 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:22 +0000 (0:00:01.965) 0:04:01.890 ***** 2019-12-19T22:04:22.210 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-12-19T22:04:22.212 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:22.260 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:22 +0000 (0:00:00.096) 0:04:01.987 ***** 2019-12-19T22:04:22.604 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2019-12-19T22:04:22.612 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "sysinit.target polkit.service basic.target dbus.service system.slice dbus.socket", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "ebtables.service ip6tables.service iptables.service shutdown.target ipset.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTim 2019-12-19T22:04:22.613 INFO:teuthology.task.ansible.out:estampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127487", "LimitNPROCSoft": "127487", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127487", 2019-12-19T22:04:22.615 INFO:teuthology.task.ansible.out:"LimitSIGPENDINGSoft": "127487", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target dbus.socket", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3 2019-12-19T22:04:22.616 INFO:teuthology.task.ansible.out:", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-12-19T22:04:22.648 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:22 +0000 (0:00:00.388) 0:04:02.375 ***** 2019-12-19T22:04:22.968 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ fatal: [smithi050.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2019-12-19T22:04:23.010 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:23 +0000 (0:00:00.361) 0:04:02.737 ***** 2019-12-19T22:04:23.782 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2019-12-19T22:04:23.783 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2019-12-19T22:04:23.823 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:23 +0000 (0:00:00.813) 0:04:03.550 ***** 2019-12-19T22:04:23.860 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2019-12-19T22:04:23.864 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:23.927 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:23 +0000 (0:00:00.104) 0:04:03.654 ***** 2019-12-19T22:04:23.962 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2019-12-19T22:04:24.000 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:23 +0000 (0:00:00.073) 0:04:03.727 ***** 2019-12-19T22:04:24.006 INFO:teuthology.task.ansible.out: 2019-12-19T22:04:24.046 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:24.082 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:24 +0000 (0:00:00.081) 0:04:03.809 ***** 2019-12-19T22:04:24.121 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:24.168 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:24 +0000 (0:00:00.085) 0:04:03.895 ***** 2019-12-19T22:04:24.207 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2019-12-19T22:04:24.209 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-12-19T22:04:24.232 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-12-19T22:04:24.275 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:24 +0000 (0:00:00.107) 0:04:04.002 ***** 2019-12-19T22:04:24.306 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:24.346 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:24 +0000 (0:00:00.071) 0:04:04.073 ***** 2019-12-19T22:04:24.372 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2019-12-19T22:04:24.409 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:24 +0000 (0:00:00.062) 0:04:04.136 ***** 2019-12-19T22:04:24.439 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:24.482 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:24 +0000 (0:00:00.073) 0:04:04.210 ***** 2019-12-19T22:04:24.535 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2019-12-19T22:04:24.536 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:24.571 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:24 +0000 (0:00:00.088) 0:04:04.299 ***** 2019-12-19T22:04:24.604 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:24.639 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:24 +0000 (0:00:00.067) 0:04:04.367 ***** 2019-12-19T22:04:24.672 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-12-19T22:04:24.673 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:24.710 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:24 +0000 (0:00:00.070) 0:04:04.437 ***** 2019-12-19T22:04:24.736 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2019-12-19T22:04:24.739 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:24.778 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:24 +0000 (0:00:00.067) 0:04:04.505 ***** 2019-12-19T22:04:24.806 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:24.842 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:24 +0000 (0:00:00.063) 0:04:04.569 ***** 2019-12-19T22:04:24.879 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2019-12-19T22:04:24.881 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:24.921 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:24 +0000 (0:00:00.078) 0:04:04.648 ***** 2019-12-19T22:04:24.946 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:24.990 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:24 +0000 (0:00:00.066) 0:04:04.714 ***** 2019-12-19T22:04:25.018 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:25.058 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:25 +0000 (0:00:00.070) 0:04:04.784 ***** 2019-12-19T22:04:25.085 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:25.125 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:25 +0000 (0:00:00.068) 0:04:04.852 ***** 2019-12-19T22:04:25.156 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:25.196 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:25 +0000 (0:00:00.068) 0:04:04.921 ***** 2019-12-19T22:04:25.231 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:25.278 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:25 +0000 (0:00:00.081) 0:04:05.002 ***** 2019-12-19T22:04:25.301 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2019-12-19T22:04:25.303 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:25.343 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:25 +0000 (0:00:00.066) 0:04:05.069 ***** 2019-12-19T22:04:25.392 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:25.431 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:25 +0000 (0:00:00.089) 0:04:05.158 ***** 2019-12-19T22:04:25.458 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-12-19T22:04:25.459 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:25.507 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:25 +0000 (0:00:00.074) 0:04:05.233 ***** 2019-12-19T22:04:25.533 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:25.572 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:25 +0000 (0:00:00.065) 0:04:05.299 ***** 2019-12-19T22:04:25.598 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-12-19T22:04:25.600 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:25.638 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:25 +0000 (0:00:00.064) 0:04:05.363 ***** 2019-12-19T22:04:25.674 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-12-19T22:04:25.675 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:25.714 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:25 +0000 (0:00:00.076) 0:04:05.440 ***** 2019-12-19T22:04:25.746 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:25.790 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:25 +0000 (0:00:00.074) 0:04:05.514 ***** 2019-12-19T22:04:25.824 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-12-19T22:04:25.826 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:25.865 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:25 +0000 (0:00:00.077) 0:04:05.592 ***** 2019-12-19T22:04:25.912 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-12-19T22:04:25.914 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:25.966 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:25 +0000 (0:00:00.101) 0:04:05.693 ***** 2019-12-19T22:04:26.008 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:26.047 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:26 +0000 (0:00:00.078) 0:04:05.771 ***** 2019-12-19T22:04:26.071 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:26.113 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:26 +0000 (0:00:00.068) 0:04:05.840 ***** 2019-12-19T22:04:26.151 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:26.188 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:26 +0000 (0:00:00.075) 0:04:05.915 ***** 2019-12-19T22:04:26.225 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-12-19T22:04:26.226 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:26.279 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:26 +0000 (0:00:00.089) 0:04:06.004 ***** 2019-12-19T22:04:26.307 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:26.346 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:26 +0000 (0:00:00.068) 0:04:06.073 ***** 2019-12-19T22:04:26.373 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-12-19T22:04:26.374 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:26.425 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:26 +0000 (0:00:00.079) 0:04:06.153 ***** 2019-12-19T22:04:26.454 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:26.500 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:26 +0000 (0:00:00.074) 0:04:06.228 ***** 2019-12-19T22:04:26.538 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:26.580 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:26 +0000 (0:00:00.078) 0:04:06.306 ***** 2019-12-19T22:04:26.607 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:26.659 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:26 +0000 (0:00:00.077) 0:04:06.384 ***** 2019-12-19T22:04:26.692 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:26.731 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:26 +0000 (0:00:00.068) 0:04:06.453 ***** 2019-12-19T22:04:26.766 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:26.817 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:26 +0000 (0:00:00.090) 0:04:06.543 ***** 2019-12-19T22:04:26.848 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:26.891 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:26 +0000 (0:00:00.073) 0:04:06.617 ***** 2019-12-19T22:04:26.928 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:26.976 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:26 +0000 (0:00:00.086) 0:04:06.703 ***** 2019-12-19T22:04:27.014 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-12-19T22:04:27.016 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:27.057 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:27 +0000 (0:00:00.076) 0:04:06.780 ***** 2019-12-19T22:04:27.083 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-12-19T22:04:27.085 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:27.132 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:27 +0000 (0:00:00.078) 0:04:06.859 ***** 2019-12-19T22:04:27.162 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:27.203 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:27 +0000 (0:00:00.071) 0:04:06.930 ***** 2019-12-19T22:04:27.240 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-12-19T22:04:27.242 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:27.280 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:27 +0000 (0:00:00.077) 0:04:07.007 ***** 2019-12-19T22:04:27.305 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2019-12-19T22:04:27.308 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:27.346 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:27 +0000 (0:00:00.063) 0:04:07.071 ***** 2019-12-19T22:04:27.371 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2019-12-19T22:04:27.373 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:27.410 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:27 +0000 (0:00:00.066) 0:04:07.137 ***** 2019-12-19T22:04:27.456 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:27.495 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:27 +0000 (0:00:00.083) 0:04:07.220 ***** 2019-12-19T22:04:27.526 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:27.578 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:27 +0000 (0:00:00.079) 0:04:07.302 ***** 2019-12-19T22:04:27.605 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:27.646 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:27 +0000 (0:00:00.066) 0:04:07.369 ***** 2019-12-19T22:04:27.678 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2019-12-19T22:04:27.682 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:27.716 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:27 +0000 (0:00:00.074) 0:04:07.443 ***** 2019-12-19T22:04:27.743 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2019-12-19T22:04:27.746 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:27.784 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:27 +0000 (0:00:00.068) 0:04:07.511 ***** 2019-12-19T22:04:27.822 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:27.863 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:27 +0000 (0:00:00.079) 0:04:07.590 ***** 2019-12-19T22:04:27.890 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2019-12-19T22:04:27.892 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:27.932 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:27 +0000 (0:00:00.068) 0:04:07.658 ***** 2019-12-19T22:04:27.957 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2019-12-19T22:04:27.959 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:27.998 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:27 +0000 (0:00:00.066) 0:04:07.725 ***** 2019-12-19T22:04:28.048 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2019-12-19T22:04:28.050 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:28.105 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:28 +0000 (0:00:00.105) 0:04:07.831 ***** 2019-12-19T22:04:28.133 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:28.187 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:28 +0000 (0:00:00.079) 0:04:07.910 ***** 2019-12-19T22:04:28.222 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:28.280 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:28 +0000 (0:00:00.097) 0:04:08.007 ***** 2019-12-19T22:04:28.327 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi050.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2019-12-19T22:04:28.384 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:28 +0000 (0:00:00.101) 0:04:08.109 ***** 2019-12-19T22:04:28.440 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi050.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2019-12-19T22:04:28.464 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2019-12-19T22:04:28.479 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2019-12-19T22:04:28.490 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2019-12-19T22:04:28.515 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} skipping: [smithi050.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2019-12-19T22:04:28.532 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2019-12-19T22:04:28.584 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:28 +0000 (0:00:00.198) 0:04:08.307 ***** 2019-12-19T22:04:28.751 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2019-12-19T22:04:28.753 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.008745", "end": "2019-12-19 22:04:28.724896", "rc": 0, "start": "2019-12-19 22:04:28.716151", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2019-12-19T22:04:28.795 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:28 +0000 (0:00:00.215) 0:04:08.522 ***** 2019-12-19T22:04:28.836 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2019-12-19T22:04:28.837 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:28.891 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:28 +0000 (0:00:00.092) 0:04:08.615 ***** 2019-12-19T22:04:28.948 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:28.987 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:28 +0000 (0:00:00.097) 0:04:08.713 ***** 2019-12-19T22:04:29.017 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2019-12-19T22:04:29.018 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:29.075 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:29 +0000 (0:00:00.086) 0:04:08.800 ***** 2019-12-19T22:04:29.102 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2019-12-19T22:04:29.106 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:29.140 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:29 +0000 (0:00:00.067) 0:04:08.867 ***** 2019-12-19T22:04:31.043 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2019-12-19T22:04:31.044 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2019-12-19T22:04:31.082 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:31 +0000 (0:00:01.941) 0:04:10.809 ***** 2019-12-19T22:04:31.139 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ ok: [smithi050.front.sepia.ceph.com] => (item={u'block_used': 12836192, u'uuid': u'cf568be9-1a39-43d2-a003-fbe6239693bc', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227258916, u'size_available': 930852519936, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60993204, u'device': u'/dev/sda1', u'inode_used': 61772, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227258916, "block_size": 4096, "block_total": 240095108, "block_used": 12836192, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60993204, "inode_total": 61054976, "inode_used": 61772, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930852519936, "size_total": 983429562368, "uuid": "cf568be9-1a39-43d2-a003-fbe6239693bc"}} 2019-12-19T22:04:31.175 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:31 +0000 (0:00:00.092) 0:04:10.902 ***** 2019-12-19T22:04:31.396 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2019-12-19T22:04:31.397 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005376", "end": "2019-12-19 22:04:31.375705", "rc": 0, "start": "2019-12-19 22:04:31.370329", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-19T22:04:31.444 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:31 +0000 (0:00:00.268) 0:04:11.171 ***** 2019-12-19T22:04:31.483 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2019-12-19T22:04:31.484 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'block_used': 12836192, u'uuid': u'cf568be9-1a39-43d2-a003-fbe6239693bc', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227258916, u'size_available': 930852519936, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60993204, u'device': u'/dev/sda1', u'inode_used': 61772, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227258916, "block_size": 4096, "block_total": 240095108, "block_used": 12836192, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60993204, "inode_total": 61054976, "inode_used": 61772, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930852519936, "size_total": 983429562368, "uuid": "cf568be9-1a39-43d2-a003-fbe6239693bc"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:31.529 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:31 +0000 (0:00:00.083) 0:04:11.255 ***** 2019-12-19T22:04:31.555 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2019-12-19T22:04:31.593 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:31 +0000 (0:00:00.064) 0:04:11.320 ***** 2019-12-19T22:04:31.633 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** skipping: [smithi050.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4HNFD', u'wwn-0x5000c500871ad2da'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W4HNFD', u'wwn': u'0x5000c500871ad2da', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'cf568be9-1a39-43d2-a003-fbe6239693bc', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4HNFD-part1', u'wwn-0x5000c500871ad2da-part1'], u'uuids': [u'cf568be9-1a39-43d2-a003-fbe6239693bc']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HNFD", "wwn-0x5000c500871ad2da"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HNFD-part1", "wwn-0x5000c500871ad2da-part1"], "labels": [], "masters": [], "uuids": ["cf568be9-1a39-43d2-a003-fbe6239693bc"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "cf568be9-1a39-43d2-a003-fbe6239693bc"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsi 2019-12-19T22:04:31.634 INFO:teuthology.task.ansible.out:ze": "512", "serial": "Z1W4HNFD", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871ad2da"}}, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:34.331 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-wuCpBc-HvDX-ofkv-KX2V-I9SZ-ymXd-yT1Pv7', u'nvme-INTEL_SSDPED1D480GA_PHMB7513001F480DGN', u'nvme-nvme.8086-50484d42373531333030314634383044474e-494e54454c2053534450454431443438304741-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series', u'support_discard': u'512', u'model': u'INTEL SSDPED1D480GA', u'size': u'447.13 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'937703088', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:02.500784", "end": "2019-12-19 22:04:34.302431", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series", "links": {"ids": ["lvm-pv-uuid-wuCpBc-HvDX-ofkv-KX2V-I9SZ-ymXd-yT1Pv7", "nvme-INTEL_SSDPED1D480GA_PHMB7513001F480DGN", "nvme-nvme.8086-50484d42373531333030314634383044474e-494e54454c2053534450454431443438304741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPED1D480GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "937703088", "sectorsize": "512", "size": "447.13 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-19 22:04:31.801647", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGP 2019-12-19T22:04:34.333 INFO:teuthology.task.ansible.out:T data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-19T22:04:35.607 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-7sMJITk3jiAM8BcxkCTVS46Hj0yJ1s4dl5hmGPpNonaYjf7iBce7JdZ1dV25VjhP'], u'uuids': [u'378dd3ea-903a-497c-aec2-7c2fe1f8bb22']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.036722", "end": "2019-12-19 22:04:35.554138", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-7sMJITk3jiAM8BcxkCTVS46Hj0yJ1s4dl5hmGPpNonaYjf7iBce7JdZ1dV25VjhP"], "labels": [], "masters": [], "uuids": ["378dd3ea-903a-497c-aec2-7c2fe1f8bb22"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-19 22:04:34.517416", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-19T22:04:36.908 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-7sMJITk3jiAM8BcxkCTVS46Hj0yJ1s4dyPUPZtgoUlen1f1NoXOTLbvLueuSLsgW'], u'uuids': [u'7717f927-2cb0-4f8b-9c40-74661fd0a868']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.048845", "end": "2019-12-19 22:04:36.846672", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-7sMJITk3jiAM8BcxkCTVS46Hj0yJ1s4dyPUPZtgoUlen1f1NoXOTLbvLueuSLsgW"], "labels": [], "masters": [], "uuids": ["7717f927-2cb0-4f8b-9c40-74661fd0a868"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-19 22:04:35.797827", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-19T22:04:38.177 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-7sMJITk3jiAM8BcxkCTVS46Hj0yJ1s4dtcbQSS5IIEDJObUGoLhvNtKHPigpOEDr'], u'uuids': [u'69d10161-1e66-48d8-badf-a39718489506']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.060722", "end": "2019-12-19 22:04:38.138609", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-7sMJITk3jiAM8BcxkCTVS46Hj0yJ1s4dtcbQSS5IIEDJObUGoLhvNtKHPigpOEDr"], "labels": [], "masters": [], "uuids": ["69d10161-1e66-48d8-badf-a39718489506"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-19 22:04:37.077887", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-19T22:04:39.450 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-7sMJITk3jiAM8BcxkCTVS46Hj0yJ1s4dOMTmi2ylthRX0yRrPURYee3sXdxEk9NG'], u'uuids': [u'26c5c784-b6db-408f-87c7-f752c29a9d9a']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.056614", "end": "2019-12-19 22:04:39.414053", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-7sMJITk3jiAM8BcxkCTVS46Hj0yJ1s4dOMTmi2ylthRX0yRrPURYee3sXdxEk9NG"], "labels": [], "masters": [], "uuids": ["26c5c784-b6db-408f-87c7-f752c29a9d9a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-19 22:04:38.357439", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-19T22:04:40.711 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-7sMJITk3jiAM8BcxkCTVS46Hj0yJ1s4dFz43vYqHAKYoL1RC1NJeyl49D0gVcY9D'], u'uuids': [u'c6b8f5c9-1d99-45dd-a81d-ab004a8369e2']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.040128", "end": "2019-12-19 22:04:40.672074", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-7sMJITk3jiAM8BcxkCTVS46Hj0yJ1s4dFz43vYqHAKYoL1RC1NJeyl49D0gVcY9D"], "labels": [], "masters": [], "uuids": ["c6b8f5c9-1d99-45dd-a81d-ab004a8369e2"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-19 22:04:39.631946", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-19T22:04:40.795 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:40 +0000 (0:00:09.202) 0:04:20.522 ***** 2019-12-19T22:04:40.876 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** skipping: [smithi050.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4HNFD', u'wwn-0x5000c500871ad2da'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W4HNFD', u'wwn': u'0x5000c500871ad2da', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'cf568be9-1a39-43d2-a003-fbe6239693bc', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4HNFD-part1', u'wwn-0x5000c500871ad2da-part1'], u'uuids': [u'cf568be9-1a39-43d2-a003-fbe6239693bc']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HNFD", "wwn-0x5000c500871ad2da"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HNFD-part1", "wwn-0x5000c500871ad2da-part1"], "labels": [], "masters": [], "uuids": ["cf568be9-1a39-43d2-a003-fbe6239693bc"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "cf568be9-1a39-43d2-a003-fbe6239693bc"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsi 2019-12-19T22:04:40.880 INFO:teuthology.task.ansible.out:ze": "512", "serial": "Z1W4HNFD", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871ad2da"}}, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:41.121 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-wuCpBc-HvDX-ofkv-KX2V-I9SZ-ymXd-yT1Pv7', u'nvme-INTEL_SSDPED1D480GA_PHMB7513001F480DGN', u'nvme-nvme.8086-50484d42373531333030314634383044474e-494e54454c2053534450454431443438304741-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series', u'support_discard': u'512', u'model': u'INTEL SSDPED1D480GA', u'size': u'447.13 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'937703088', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.036132", "end": "2019-12-19 22:04:41.094212", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series", "links": {"ids": ["lvm-pv-uuid-wuCpBc-HvDX-ofkv-KX2V-I9SZ-ymXd-yT1Pv7", "nvme-INTEL_SSDPED1D480GA_PHMB7513001F480DGN", "nvme-nvme.8086-50484d42373531333030314634383044474e-494e54454c2053534450454431443438304741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPED1D480GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "937703088", "sectorsize": "512", "size": "447.13 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-19 22:04:41.058080", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 2019-12-19T22:04:41.123 INFO:teuthology.task.ansible.out: 0.0334778 s, 3.4 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0334778 s, 3.4 GB/s"], "stdout": "", "stdout_lines": []} 2019-12-19T22:04:41.444 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-7sMJITk3jiAM8BcxkCTVS46Hj0yJ1s4dl5hmGPpNonaYjf7iBce7JdZ1dV25VjhP'], u'uuids': [u'378dd3ea-903a-497c-aec2-7c2fe1f8bb22']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.095184", "end": "2019-12-19 22:04:41.409008", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-7sMJITk3jiAM8BcxkCTVS46Hj0yJ1s4dl5hmGPpNonaYjf7iBce7JdZ1dV25VjhP"], "labels": [], "masters": [], "uuids": ["378dd3ea-903a-497c-aec2-7c2fe1f8bb22"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-19 22:04:41.313824", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0925993 s, 1.2 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0925993 s, 1.2 GB/s"], "stdout": "", "stdout_lines": []} 2019-12-19T22:04:41.757 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-7sMJITk3jiAM8BcxkCTVS46Hj0yJ1s4dyPUPZtgoUlen1f1NoXOTLbvLueuSLsgW'], u'uuids': [u'7717f927-2cb0-4f8b-9c40-74661fd0a868']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.094436", "end": "2019-12-19 22:04:41.720490", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-7sMJITk3jiAM8BcxkCTVS46Hj0yJ1s4dyPUPZtgoUlen1f1NoXOTLbvLueuSLsgW"], "labels": [], "masters": [], "uuids": ["7717f927-2cb0-4f8b-9c40-74661fd0a868"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-19 22:04:41.626054", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.091825 s, 1.3 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.091825 s, 1.3 GB/s"], "stdout": "", "stdout_lines": []} 2019-12-19T22:04:42.051 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-7sMJITk3jiAM8BcxkCTVS46Hj0yJ1s4dtcbQSS5IIEDJObUGoLhvNtKHPigpOEDr'], u'uuids': [u'69d10161-1e66-48d8-badf-a39718489506']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.093993", "end": "2019-12-19 22:04:42.022336", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-7sMJITk3jiAM8BcxkCTVS46Hj0yJ1s4dtcbQSS5IIEDJObUGoLhvNtKHPigpOEDr"], "labels": [], "masters": [], "uuids": ["69d10161-1e66-48d8-badf-a39718489506"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-19 22:04:41.928343", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0913132 s, 1.3 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0913132 s, 1.3 GB/s"], "stdout": "", "stdout_lines": []} 2019-12-19T22:04:42.342 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-7sMJITk3jiAM8BcxkCTVS46Hj0yJ1s4dOMTmi2ylthRX0yRrPURYee3sXdxEk9NG'], u'uuids': [u'26c5c784-b6db-408f-87c7-f752c29a9d9a']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.094089", "end": "2019-12-19 22:04:42.315851", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-7sMJITk3jiAM8BcxkCTVS46Hj0yJ1s4dOMTmi2ylthRX0yRrPURYee3sXdxEk9NG"], "labels": [], "masters": [], "uuids": ["26c5c784-b6db-408f-87c7-f752c29a9d9a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-19 22:04:42.221762", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0915016 s, 1.3 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0915016 s, 1.3 GB/s"], "stdout": "", "stdout_lines": []} 2019-12-19T22:04:42.645 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-7sMJITk3jiAM8BcxkCTVS46Hj0yJ1s4dFz43vYqHAKYoL1RC1NJeyl49D0gVcY9D'], u'uuids': [u'c6b8f5c9-1d99-45dd-a81d-ab004a8369e2']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.099146", "end": "2019-12-19 22:04:42.616464", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-7sMJITk3jiAM8BcxkCTVS46Hj0yJ1s4dFz43vYqHAKYoL1RC1NJeyl49D0gVcY9D"], "labels": [], "masters": [], "uuids": ["c6b8f5c9-1d99-45dd-a81d-ab004a8369e2"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-19 22:04:42.517318", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0964906 s, 1.2 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0964906 s, 1.2 GB/s"], "stdout": "", "stdout_lines": []} 2019-12-19T22:04:42.696 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:42 +0000 (0:00:01.901) 0:04:22.423 ***** 2019-12-19T22:04:42.987 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** changed: [smithi050.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.070374", "end": "2019-12-19 22:04:42.945867", "rc": 0, "start": "2019-12-19 22:04:42.875493", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-19T22:04:43.024 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:43 +0000 (0:00:00.327) 0:04:22.750 ***** 2019-12-19T22:04:43.283 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2019-12-19T22:04:43.284 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.048538", "end": "2019-12-19 22:04:43.259915", "rc": 0, "start": "2019-12-19 22:04:43.211377", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-19T22:04:43.334 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:43 +0000 (0:00:00.310) 0:04:23.061 ***** 2019-12-19T22:04:43.362 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2019-12-19T22:04:43.413 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:43 +0000 (0:00:00.078) 0:04:23.140 ***** 2019-12-19T22:04:43.439 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2019-12-19T22:04:43.441 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:43.487 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:43 +0000 (0:00:00.073) 0:04:23.214 ***** 2019-12-19T22:04:43.525 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2019-12-19T22:04:43.526 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:43.563 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:43 +0000 (0:00:00.075) 0:04:23.290 ***** 2019-12-19T22:04:43.595 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-12-19T22:04:43.597 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:43.645 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:43 +0000 (0:00:00.082) 0:04:23.373 ***** 2019-12-19T22:04:43.675 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:43.721 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:43 +0000 (0:00:00.075) 0:04:23.448 ***** 2019-12-19T22:04:43.937 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2019-12-19T22:04:43.938 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-19T22:04:43.978 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:43 +0000 (0:00:00.257) 0:04:23.705 ***** 2019-12-19T22:04:44.035 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-12-19T22:04:44.037 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={u'block_used': 12836192, u'uuid': u'cf568be9-1a39-43d2-a003-fbe6239693bc', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227258916, u'size_available': 930852519936, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60993204, u'device': u'/dev/sda1', u'inode_used': 61772, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227258916, "block_size": 4096, "block_total": 240095108, "block_used": 12836192, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60993204, "inode_total": 61054976, "inode_used": 61772, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930852519936, "size_total": 983429562368, "uuid": "cf568be9-1a39-43d2-a003-fbe6239693bc"}, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:44.076 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:44 +0000 (0:00:00.097) 0:04:23.803 ***** 2019-12-19T22:04:44.103 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2019-12-19T22:04:44.104 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:44.152 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:44 +0000 (0:00:00.075) 0:04:23.879 ***** 2019-12-19T22:04:44.179 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-19T22:04:44.181 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:44.220 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:44 +0000 (0:00:00.067) 0:04:23.947 ***** 2019-12-19T22:04:44.259 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-19T22:04:44.261 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:44.298 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:44 +0000 (0:00:00.078) 0:04:24.026 ***** 2019-12-19T22:04:44.336 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2019-12-19T22:04:44.338 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:44.395 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:44 +0000 (0:00:00.092) 0:04:24.118 ***** 2019-12-19T22:04:44.421 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2019-12-19T22:04:44.423 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:44.462 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:44 +0000 (0:00:00.070) 0:04:24.189 ***** 2019-12-19T22:04:44.500 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2019-12-19T22:04:44.502 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:44.547 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:44 +0000 (0:00:00.084) 0:04:24.274 ***** 2019-12-19T22:04:45.326 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** changed: [smithi050.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2019-12-19T22:04:45.380 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:45 +0000 (0:00:00.832) 0:04:25.107 ***** 2019-12-19T22:04:46.088 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi050.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-19T22:04:46.454 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-19T22:04:46.815 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-19T22:04:47.204 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-19T22:04:47.569 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-19T22:04:47.659 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:47 +0000 (0:00:02.277) 0:04:27.385 ***** 2019-12-19T22:04:47.886 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-12-19T22:04:47.887 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2019-12-19T22:04:47.928 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:47 +0000 (0:00:00.270) 0:04:27.655 ***** 2019-12-19T22:04:47.964 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-12-19T22:04:47.966 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:48.169 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-19T22:04:48.379 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-19T22:04:48.576 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-19T22:04:48.806 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-19T22:04:48.875 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:48 +0000 (0:00:00.947) 0:04:28.602 ***** 2019-12-19T22:04:49.109 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-12-19T22:04:49.147 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:49 +0000 (0:00:00.271) 0:04:28.874 ***** 2019-12-19T22:04:49.185 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2019-12-19T22:04:49.186 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:49.248 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:49 +0000 (0:00:00.101) 0:04:28.975 ***** 2019-12-19T22:04:49.906 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2019-12-19T22:04:49.908 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => {"changed": true} 2019-12-19T22:04:49.959 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:49 +0000 (0:00:00.711) 0:04:29.687 ***** 2019-12-19T22:04:50.660 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2019-12-19T22:04:50.663 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2019-12-19T22:04:50.712 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:50 +0000 (0:00:00.752) 0:04:30.439 ***** 2019-12-19T22:04:50.757 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2019-12-19T22:04:50.758 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:50.804 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:50 +0000 (0:00:00.091) 0:04:30.531 ***** 2019-12-19T22:04:50.835 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2019-12-19T22:04:50.837 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:50.880 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:50 +0000 (0:00:00.076) 0:04:30.607 ***** 2019-12-19T22:04:50.923 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:50.957 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:50 +0000 (0:00:00.076) 0:04:30.684 ***** 2019-12-19T22:04:50.988 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:51.037 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:51 +0000 (0:00:00.077) 0:04:30.761 ***** 2019-12-19T22:04:51.070 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2019-12-19T22:04:51.072 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:51.112 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:51 +0000 (0:00:00.076) 0:04:30.838 ***** 2019-12-19T22:04:51.148 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2019-12-19T22:04:51.149 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:51.199 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:51 +0000 (0:00:00.087) 0:04:30.926 ***** 2019-12-19T22:04:51.229 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:51.272 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:51 +0000 (0:00:00.070) 0:04:30.996 ***** 2019-12-19T22:04:51.318 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:51.360 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:51 +0000 (0:00:00.090) 0:04:31.087 ***** 2019-12-19T22:04:51.387 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:51.440 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:51 +0000 (0:00:00.079) 0:04:31.167 ***** 2019-12-19T22:04:51.482 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2019-12-19T22:04:51.483 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:51.533 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:51 +0000 (0:00:00.089) 0:04:31.257 ***** 2019-12-19T22:04:51.567 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2019-12-19T22:04:51.569 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:51.607 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:51 +0000 (0:00:00.077) 0:04:31.334 ***** 2019-12-19T22:04:52.164 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2019-12-19T22:04:52.216 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:52 +0000 (0:00:00.603) 0:04:31.938 ***** 2019-12-19T22:04:52.563 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2019-12-19 21:59:22 UTC", "ActiveEnterTimestampMonotonic": "13476173", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service ntpd.service system.slice -.mount basic.target sysinit.target systemd-journald.socket tmp.mount sntp.service ntpdate.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2019-12-19 21:59:20 UTC", "AssertTimestampMonotonic": "12175050", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2019-12-19 21:59:20 UTC", "ConditionTimestampMonotonic": "12175022", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service ntpd.service", "ControlGroup": "/system.slice/chronyd.servic 2019-12-19T22:04:52.564 INFO:teuthology.task.ansible.out:e", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "783", "ExecMainStartTimestamp": "Thu 2019-12-19 21:59:22 UTC", "ExecMainStartTimestampMonotonic": "13416299", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2019-12-19 21:59:20 UTC", "InactiveExitTimestampMonotonic": "12235392", "InvocationID": "a447c0c8ba5a47f4beb8df0a24bd8cf4", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinit 2019-12-19T22:04:52.566 INFO:teuthology.task.ansible.out:y", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127487", "LimitNPROCSoft": "127487", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127487", "LimitSIGPENDINGSoft": "127487", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "783", "MemoryAccounting": "yes", "MemoryCurrent": "2613248", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/var/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBit 2019-12-19T22:04:52.567 INFO:teuthology.task.ansible.out:s": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2019-12-19 21:59:22 UTC", "StateChangeTimestampMonotonic": "13476173", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2019-12-19 21:59:22 UTC", "WatchdogTimestampMonotonic": "13416315", "WatchdogUSec": "0"}} 2019-12-19T22:04:52.636 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:52 +0000 (0:00:00.424) 0:04:32.363 ***** 2019-12-19T22:04:52.671 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:52.705 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:52 +0000 (0:00:00.067) 0:04:32.430 ***** 2019-12-19T22:04:52.745 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:52.781 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:52 +0000 (0:00:00.077) 0:04:32.508 ***** 2019-12-19T22:04:52.819 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:52.854 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:52 +0000 (0:00:00.071) 0:04:32.580 ***** 2019-12-19T22:04:53.093 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2019-12-19T22:04:53.094 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "gid": 1205, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2019-12-19T22:04:53.141 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:53 +0000 (0:00:00.287) 0:04:32.867 ***** 2019-12-19T22:04:53.690 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2019-12-19T22:04:53.691 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1205, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2019-12-19T22:04:53.730 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:53 +0000 (0:00:00.589) 0:04:33.457 ***** 2019-12-19T22:04:55.279 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2019-12-19T22:04:55.281 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2019-12-19T22:04:55.318 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:55 +0000 (0:00:01.588) 0:04:35.045 ***** 2019-12-19T22:04:55.344 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2019-12-19T22:04:55.346 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:55.387 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:55 +0000 (0:00:00.068) 0:04:35.114 ***** 2019-12-19T22:04:55.426 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ ok: [smithi050.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} 2019-12-19T22:04:55.465 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:55 +0000 (0:00:00.077) 0:04:35.192 ***** 2019-12-19T22:04:55.675 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** ok: [smithi050.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2019-12-19T22:04:55.728 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:55 +0000 (0:00:00.262) 0:04:35.454 ***** 2019-12-19T22:04:55.758 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2019-12-19T22:04:55.759 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:55.802 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:55 +0000 (0:00:00.074) 0:04:35.528 ***** 2019-12-19T22:04:55.839 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [smithi050.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2019-12-19T22:04:55.890 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:55 +0000 (0:00:00.088) 0:04:35.617 ***** 2019-12-19T22:04:55.916 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2019-12-19T22:04:55.918 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:55.964 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:55 +0000 (0:00:00.074) 0:04:35.692 ***** 2019-12-19T22:04:56.196 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2019-12-19T22:04:56.198 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2019-12-19T22:04:56.244 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:56 +0000 (0:00:00.279) 0:04:35.971 ***** 2019-12-19T22:04:56.471 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2019-12-19T22:04:56.472 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2019-12-19T22:04:56.523 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:56 +0000 (0:00:00.278) 0:04:36.250 ***** 2019-12-19T22:04:56.551 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2019-12-19T22:04:56.553 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:56.603 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:56 +0000 (0:00:00.079) 0:04:36.329 ***** 2019-12-19T22:04:56.651 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2019-12-19T22:04:56.652 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} 2019-12-19T22:04:56.665 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2019-12-19T22:04:56.665 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2019-12-19T22:04:56.668 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2019-12-19T22:04:56.679 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} 2019-12-19T22:04:56.736 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:56 +0000 (0:00:00.133) 0:04:36.463 ***** 2019-12-19T22:04:56.784 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2019-12-19T22:04:56.785 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'ens1f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:56.797 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:56.799 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:56.825 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:56.836 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'ens1f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:56.910 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:56 +0000 (0:00:00.173) 0:04:36.637 ***** 2019-12-19T22:04:56.941 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-19T22:04:56.943 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:56.988 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:56 +0000 (0:00:00.078) 0:04:36.715 ***** 2019-12-19T22:04:57.027 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:57.068 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:57 +0000 (0:00:00.076) 0:04:36.792 ***** 2019-12-19T22:04:57.093 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:57.135 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:57 +0000 (0:00:00.069) 0:04:36.862 ***** 2019-12-19T22:04:57.162 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2019-12-19T22:04:57.163 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:57.221 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:57 +0000 (0:00:00.086) 0:04:36.948 ***** 2019-12-19T22:04:57.247 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2019-12-19T22:04:57.249 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:57.306 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:57 +0000 (0:00:00.084) 0:04:37.033 ***** 2019-12-19T22:04:57.332 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-12-19T22:04:57.334 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:57.376 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:57 +0000 (0:00:00.070) 0:04:37.103 ***** 2019-12-19T22:04:57.405 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2019-12-19T22:04:57.407 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:57.453 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:57 +0000 (0:00:00.076) 0:04:37.180 ***** 2019-12-19T22:04:57.490 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-12-19T22:04:57.491 INFO:teuthology.task.ansible.out:skipping: [smithi050.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-19T22:04:57.536 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:57 +0000 (0:00:00.079) 0:04:37.259 ***** 2019-12-19T22:04:58.803 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-12-19T22:04:58.803 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:01.006636", "end": "2019-12-19 22:04:58.752300", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2019-12-19 22:04:57.745664", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-19T22:04:59.019 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003120", "end": "2019-12-19 22:04:58.976819", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2019-12-19 22:04:58.973699", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-19T22:04:59.243 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.003007", "end": "2019-12-19 22:04:59.194611", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2019-12-19 22:04:59.191604", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2019-12-19T22:04:59.470 INFO:teuthology.task.ansible.out:ok: [smithi050.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.027315", "end": "2019-12-19 22:04:59.435300", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2019-12-19 22:04:59.407985", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-19T22:04:59.525 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:59 +0000 (0:00:01.992) 0:04:39.252 ***** 2019-12-19T22:04:59.559 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2019-12-19T22:04:59.618 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:59 +0000 (0:00:00.092) 0:04:39.345 ***** 2019-12-19T22:04:59.839 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2019-12-19T22:04:59.844 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2019-12-19T22:04:59.896 INFO:teuthology.task.ansible.out:Thursday 19 December 2019 22:04:59 +0000 (0:00:00.277) 0:04:39.623 ***** 2019-12-19T22:05:00.299 INFO:teuthology.task.ansible.out: RUNNING HANDLER [common : restart nagios-nrpe-server] ************************** 2019-12-19T22:05:00.301 INFO:teuthology.task.ansible.out:changed: [smithi050.front.sepia.ceph.com] => {"changed": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2019-12-19 22:03:07 UTC", "ActiveEnterTimestampMonotonic": "239187942", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service system.slice time-sync.target basic.target sysinit.target -.mount systemd-journald.socket tmp.mount local-fs.target var-run.mount network.target nss-lookup.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2019-12-19 22:03:07 UTC", "AssertTimestampMonotonic": "239187153", "Before": "plymouth-quit.service shutdown.target multi-user.target xdm.service getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2019-12-19 22:03:07 UTC", "ConditionTimestampMonotonic": "239187153", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDepe 2019-12-19T22:05:00.303 INFO:teuthology.task.ansible.out:ndencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "16552", "ExecMainStartTimestamp": "Thu 2019-12-19 22:03:07 UTC", "ExecMainStartTimestampMonotonic": "239187914", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "985", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2019-12-19 22:03:07 UTC", "InactiveExitTimestampMonotonic": "239187942", "InvocationID": "fbce2fc4328e404ea8dcc31c552d224d", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft 2019-12-19T22:05:00.304 INFO:teuthology.task.ansible.out:": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127487", "LimitNPROCSoft": "127487", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127487", "LimitSIGPENDINGSoft": "127487", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "16552", "MemoryAccounting": "yes", "MemoryCurrent": "716800", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/run/nrpe /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode": "075 2019-12-19T22:05:00.306 INFO:teuthology.task.ansible.out:5", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2019-12-19 22:03:07 UTC", "StateChangeTimestampMonotonic": "239187942", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "989", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2019-12-19 22:03:07 UTC", "WatchdogTimestampMonotonic": "239187941", "WatchdogUSec": "0"}} 2019-12-19T22:05:00.372 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2019-12-19T22:05:00.374 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2019-12-19T22:05:00.376 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched 2019-12-19T22:05:00.378 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* smithi050.front.sepia.ceph.com : ok=130 changed=54 unreachable=0 failed=0 skipped=153 rescued=0 ignored=4 Thursday 19 December 2019 22:05:00 +0000 (0:00:00.481) 0:04:40.104 ***** =============================================================================== 2019-12-19T22:05:00.378 INFO:teuthology.task.ansible.out:users : Update authorized_keys using the keys repo --------------------- 32.86s users : Create all admin users with sudo access. ----------------------- 25.87s testnode : Install packages -------------------------------------------- 20.08s common : nrpe - Load SELinux policy package ---------------------------- 16.79s common : Disable all rhsm repos ---------------------------------------- 11.89s common : Get list of enabled RHSM repos -------------------------------- 11.14s 2019-12-19T22:05:00.378 INFO:teuthology.task.ansible.out:common : Enable necessary rhsm repos ----------------------------------- 11.09s testnode : Zap all non-root disks --------------------------------------- 9.20s common : Install nrpe package and dependencies (RHEL/CentOS) ------------ 9.15s users : Remove revoked users -------------------------------------------- 9.08s common : Register with subscription-manager. ---------------------------- 8.41s testnode : Ensure ceph packages are not present. ------------------------ 8.24s common : Update yum cache ----------------------------------------------- 5.71s testnode : Ensure ceph dependency packages are not present. ------------- 5.34s 2019-12-19T22:05:00.378 INFO:teuthology.task.ansible.out:common : Install Kerberos Packages (RedHat) ----------------------------- 4.44s ansible-managed : Add authorized keys for the ansible user. ------------- 2.87s Gathering Facts --------------------------------------------------------- 2.81s users : Update authorized_keys for each user with literal keys ---------- 2.43s testnode : Create logical volume(s) ------------------------------------- 2.28s common : nrpe - Set SELinux boolean nagios_run_sudo true ---------------- 2.24s 2019-12-19T22:05:00.674 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi050.front.sepia.ceph.com')] 2019-12-19T22:05:00.684 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-19T22:05:00.684 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi050.front.sepia.ceph.com', 'timeout': 60} 2019-12-19T22:05:00.778 INFO:teuthology.orchestra.run.smithi050:> true 2019-12-19T22:05:00.868 INFO:teuthology.run_tasks:Running task clock... 2019-12-19T22:05:00.890 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2019-12-19T22:05:00.890 INFO:teuthology.orchestra.run.smithi050:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2019-12-19T22:05:00.946 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2019-12-19T22:05:00.967 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2019-12-19T22:05:01.017 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: ntpd: command not found 2019-12-19T22:05:01.034 INFO:teuthology.orchestra.run.smithi050.stdout:506 Cannot talk to daemon 2019-12-19T22:05:01.055 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to start ntp.service: Unit ntp.service not found. 2019-12-19T22:05:01.076 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2019-12-19T22:05:01.139 INFO:teuthology.orchestra.run.smithi050.stderr:bash: ntpq: command not found 2019-12-19T22:05:01.142 INFO:teuthology.orchestra.run.smithi050.stdout:210 Number of sources = 4 2019-12-19T22:05:01.142 INFO:teuthology.orchestra.run.smithi050.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2019-12-19T22:05:01.142 INFO:teuthology.orchestra.run.smithi050.stdout:=============================================================================== 2019-12-19T22:05:01.142 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2019-12-19T22:05:01.142 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2019-12-19T22:05:01.143 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2019-12-19T22:05:01.143 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2019-12-19T22:05:01.143 INFO:teuthology.run_tasks:Running task install... 2019-12-19T22:05:01.157 DEBUG:teuthology.task.install:project ceph 2019-12-19T22:05:01.158 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': '368c5a40f375d6b61b7b988b7a7f4598540a0665'}} 2019-12-19T22:05:01.158 DEBUG:teuthology.task.install:config {'sha1': '368c5a40f375d6b61b7b988b7a7f4598540a0665'} 2019-12-19T22:05:01.158 INFO:teuthology.task.install:Using flavor: basic 2019-12-19T22:05:01.163 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'cephadm', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-cloud', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse']} 2019-12-19T22:05:01.163 INFO:teuthology.task.install:extra packages: [] 2019-12-19T22:05:01.164 INFO:teuthology.orchestra.run.smithi050:> sudo lsb_release -is 2019-12-19T22:05:01.223 INFO:teuthology.orchestra.run.smithi050.stdout:RedHatEnterprise 2019-12-19T22:05:01.225 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2019-12-19T22:05:01.229 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': '368c5a40f375d6b61b7b988b7a7f4598540a0665', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': [], 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': [], 'flavor': 'basic', 'extras': None} 2019-12-19T22:05:01.229 INFO:teuthology.orchestra.run.smithi050:> sudo lsb_release -is 2019-12-19T22:05:01.307 INFO:teuthology.orchestra.run.smithi050.stdout:RedHatEnterprise 2019-12-19T22:05:01.307 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2019-12-19T22:05:01.308 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=368c5a40f375d6b61b7b988b7a7f4598540a0665 2019-12-19T22:05:01.472 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-sjust-read-from-replica/368c5a40f375d6b61b7b988b7a7f4598540a0665/centos/8/flavors/default/ 2019-12-19T22:05:01.473 INFO:teuthology.task.install.rpm:Package version is 15.0.0-8663.g368c5a4 2019-12-19T22:05:01.592 INFO:teuthology.orchestra.run.smithi050:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2019-12-19T22:05:01.638 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, cephadm, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-cloud, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse on remote rpm x86_64 2019-12-19T22:05:01.639 INFO:teuthology.orchestra.run.smithi050:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/368c5a40f375d6b61b7b988b7a7f4598540a0665/;g' /etc/yum.repos.d/ceph.repo ; fi 2019-12-19T22:05:01.711 INFO:teuthology.orchestra.run.smithi050:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2019-12-19T22:05:01.800 INFO:teuthology.orchestra.run.smithi050:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2019-12-19T22:05:01.832 INFO:teuthology.orchestra.run.smithi050.stdout:check_obsoletes = 1 2019-12-19T22:05:01.833 INFO:teuthology.orchestra.run.smithi050:> sudo yum clean all 2019-12-19T22:05:02.222 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2019-12-19T22:05:03.056 INFO:teuthology.orchestra.run.smithi050.stdout:61 files removed 2019-12-19T22:05:03.102 INFO:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-radosgw 2019-12-19T22:05:03.449 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2019-12-19T22:05:04.324 INFO:teuthology.orchestra.run.smithi050.stdout:ceph packages for x86_64 308 kB/s | 68 kB 00:00 2019-12-19T22:05:04.539 INFO:teuthology.orchestra.run.smithi050.stdout:ceph noarch packages 66 kB/s | 12 kB 00:00 2019-12-19T22:05:04.748 INFO:teuthology.orchestra.run.smithi050.stdout:ceph source packages 7.5 kB/s | 1.4 kB 00:00 2019-12-19T22:05:05.295 INFO:teuthology.orchestra.run.smithi050.stdout:Copr repo for ceph-el8 owned by ktdreyer 66 kB/s | 35 kB 00:00 2019-12-19T22:05:07.138 INFO:teuthology.orchestra.run.smithi050.stdout:Extra Packages for Enterprise Linux 8 - x86_64 2.4 MB/s | 4.3 MB 00:01 2019-12-19T22:05:08.055 INFO:teuthology.orchestra.run.smithi050.stdout:lab-extras 4.5 MB/s | 33 kB 00:00 2019-12-19T22:05:08.338 INFO:teuthology.orchestra.run.smithi050.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 38 MB/s | 9.4 MB 00:00 2019-12-19T22:05:09.974 INFO:teuthology.orchestra.run.smithi050.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 42 MB/s | 8.1 MB 00:00 2019-12-19T22:05:12.311 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2019-12-19T22:05:12.315 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:05:12.315 INFO:teuthology.orchestra.run.smithi050.stdout: Package ArchVersion Repository Size 2019-12-19T22:05:12.315 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:05:12.315 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2019-12-19T22:05:12.316 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-radosgw x86_642:15.0.0-8663.g368c5a4.el8 ceph 6.3 M 2019-12-19T22:05:12.316 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2019-12-19T22:05:12.316 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base x86_642:15.0.0-8663.g368c5a4.el8 ceph 5.4 M 2019-12-19T22:05:12.316 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-common x86_642:15.0.0-8663.g368c5a4.el8 ceph 20 M 2019-12-19T22:05:12.316 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-selinux x86_642:15.0.0-8663.g368c5a4.el8 ceph 25 k 2019-12-19T22:05:12.316 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs2 x86_642:15.0.0-8663.g368c5a4.el8 ceph 504 k 2019-12-19T22:05:12.316 INFO:teuthology.orchestra.run.smithi050.stdout: librados2 x86_642:15.0.0-8663.g368c5a4.el8 ceph 3.5 M 2019-12-19T22:05:12.317 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1 x86_642:15.0.0-8663.g368c5a4.el8 ceph 377 k 2019-12-19T22:05:12.317 INFO:teuthology.orchestra.run.smithi050.stdout: librbd1 x86_642:15.0.0-8663.g368c5a4.el8 ceph 1.9 M 2019-12-19T22:05:12.317 INFO:teuthology.orchestra.run.smithi050.stdout: librgw2 x86_642:15.0.0-8663.g368c5a4.el8 ceph 5.6 M 2019-12-19T22:05:12.317 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse x86_642:15.0.0-8663.g368c5a4.el8 ceph 40 k 2019-12-19T22:05:12.317 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common x86_642:15.0.0-8663.g368c5a4.el8 ceph 46 k 2019-12-19T22:05:12.317 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cephfs x86_642:15.0.0-8663.g368c5a4.el8 ceph 146 k 2019-12-19T22:05:12.318 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rados x86_642:15.0.0-8663.g368c5a4.el8 ceph 349 k 2019-12-19T22:05:12.318 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rbd x86_642:15.0.0-8663.g368c5a4.el8 ceph 302 k 2019-12-19T22:05:12.324 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rgw x86_642:15.0.0-8663.g368c5a4.el8 ceph 113 k 2019-12-19T22:05:12.325 INFO:teuthology.orchestra.run.smithi050.stdout: gperftools-libs x86_642.7-6.el8 epel 315 k 2019-12-19T22:05:12.325 INFO:teuthology.orchestra.run.smithi050.stdout: liboath x86_642.6.2-3.el8 epel 59 k 2019-12-19T22:05:12.325 INFO:teuthology.orchestra.run.smithi050.stdout: libunwind x86_641.3.1-3.el8 epel 75 k 2019-12-19T22:05:12.325 INFO:teuthology.orchestra.run.smithi050.stdout: leveldb x86_641.21-2.el8 lab-extras 179 k 2019-12-19T22:05:12.325 INFO:teuthology.orchestra.run.smithi050.stdout: libbabeltrace x86_641.5.6-2.el8 lab-extras 200 k 2019-12-19T22:05:12.325 INFO:teuthology.orchestra.run.smithi050.stdout: lttng-ust x86_642.8.1-11.el8 lab-extras 257 k 2019-12-19T22:05:12.325 INFO:teuthology.orchestra.run.smithi050.stdout: python3-prettytable noarch0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2019-12-19T22:05:12.326 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka x86_640.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2019-12-19T22:05:12.326 INFO:teuthology.orchestra.run.smithi050.stdout: rdma-core x86_6422-2.el8 rhel-8-for-x86_64-baseos-rpms 53 k 2019-12-19T22:05:12.326 INFO:teuthology.orchestra.run.smithi050.stdout: librdmacm x86_6422-2.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2019-12-19T22:05:12.326 INFO:teuthology.orchestra.run.smithi050.stdout: userspace-rcu x86_640.10.1-2.el8 rhel-8-for-x86_64-baseos-rpms 101 k 2019-12-19T22:05:12.326 INFO:teuthology.orchestra.run.smithi050.stdout: librabbitmq x86_640.9.0-1.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2019-12-19T22:05:12.326 INFO:teuthology.orchestra.run.smithi050.stdout: libibverbs x86_6422-2.el8 rhel-8-for-x86_64-baseos-rpms 237 k 2019-12-19T22:05:12.326 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:05:12.326 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2019-12-19T22:05:12.327 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:05:12.327 INFO:teuthology.orchestra.run.smithi050.stdout:Install 28 Packages 2019-12-19T22:05:12.327 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:05:12.328 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 46 M 2019-12-19T22:05:12.328 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 190 M 2019-12-19T22:05:12.328 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2019-12-19T22:05:12.944 INFO:teuthology.orchestra.run.smithi050.stdout:(1/28): ceph-base-15.0.0-8663.g368c5a4.el8.x86_ 9.0 MB/s | 5.4 MB 00:00 2019-12-19T22:05:12.985 INFO:teuthology.orchestra.run.smithi050.stdout:(2/28): ceph-selinux-15.0.0-8663.g368c5a4.el8.x 615 kB/s | 25 kB 00:00 2019-12-19T22:05:13.046 INFO:teuthology.orchestra.run.smithi050.stdout:(3/28): libcephfs2-15.0.0-8663.g368c5a4.el8.x86 8.1 MB/s | 504 kB 00:00 2019-12-19T22:05:13.369 INFO:teuthology.orchestra.run.smithi050.stdout:(4/28): ceph-radosgw-15.0.0-8663.g368c5a4.el8.x 6.2 MB/s | 6.3 MB 00:01 2019-12-19T22:05:13.413 INFO:teuthology.orchestra.run.smithi050.stdout:(5/28): librados2-15.0.0-8663.g368c5a4.el8.x86_ 9.6 MB/s | 3.5 MB 00:00 2019-12-19T22:05:13.455 INFO:teuthology.orchestra.run.smithi050.stdout:(6/28): libradosstriper1-15.0.0-8663.g368c5a4.e 4.3 MB/s | 377 kB 00:00 2019-12-19T22:05:13.648 INFO:teuthology.orchestra.run.smithi050.stdout:(7/28): librbd1-15.0.0-8663.g368c5a4.el8.x86_64 8.0 MB/s | 1.9 MB 00:00 2019-12-19T22:05:13.715 INFO:teuthology.orchestra.run.smithi050.stdout:(8/28): python3-ceph-argparse-15.0.0-8663.g368c 576 kB/s | 40 kB 00:00 2019-12-19T22:05:13.765 INFO:teuthology.orchestra.run.smithi050.stdout:(9/28): python3-ceph-common-15.0.0-8663.g368c5a 947 kB/s | 46 kB 00:00 2019-12-19T22:05:13.816 INFO:teuthology.orchestra.run.smithi050.stdout:(10/28): python3-cephfs-15.0.0-8663.g368c5a4.el 2.8 MB/s | 146 kB 00:00 2019-12-19T22:05:13.876 INFO:teuthology.orchestra.run.smithi050.stdout:(11/28): python3-rados-15.0.0-8663.g368c5a4.el8 5.7 MB/s | 349 kB 00:00 2019-12-19T22:05:13.936 INFO:teuthology.orchestra.run.smithi050.stdout:(12/28): python3-rbd-15.0.0-8663.g368c5a4.el8.x 5.0 MB/s | 302 kB 00:00 2019-12-19T22:05:13.989 INFO:teuthology.orchestra.run.smithi050.stdout:(13/28): python3-rgw-15.0.0-8663.g368c5a4.el8.x 2.1 MB/s | 113 kB 00:00 2019-12-19T22:05:14.244 INFO:teuthology.orchestra.run.smithi050.stdout:(14/28): gperftools-libs-2.7-6.el8.x86_64.rpm 1.2 MB/s | 315 kB 00:00 2019-12-19T22:05:14.281 INFO:teuthology.orchestra.run.smithi050.stdout:(15/28): liboath-2.6.2-3.el8.x86_64.rpm 1.5 MB/s | 59 kB 00:00 2019-12-19T22:05:14.334 INFO:teuthology.orchestra.run.smithi050.stdout:(16/28): libunwind-1.3.1-3.el8.x86_64.rpm 1.4 MB/s | 75 kB 00:00 2019-12-19T22:05:14.338 INFO:teuthology.orchestra.run.smithi050.stdout:(17/28): leveldb-1.21-2.el8.x86_64.rpm 40 MB/s | 179 kB 00:00 2019-12-19T22:05:14.341 INFO:teuthology.orchestra.run.smithi050.stdout:(18/28): libbabeltrace-1.5.6-2.el8.x86_64.rpm 65 MB/s | 200 kB 00:00 2019-12-19T22:05:14.347 INFO:teuthology.orchestra.run.smithi050.stdout:(19/28): lttng-ust-2.8.1-11.el8.x86_64.rpm 72 MB/s | 257 kB 00:00 2019-12-19T22:05:14.389 INFO:teuthology.orchestra.run.smithi050.stdout:(20/28): python3-prettytable-0.7.2-14.el8.noarc 1.1 MB/s | 44 kB 00:00 2019-12-19T22:05:14.425 INFO:teuthology.orchestra.run.smithi050.stdout:(21/28): librgw2-15.0.0-8663.g368c5a4.el8.x86_6 5.8 MB/s | 5.6 MB 00:00 2019-12-19T22:05:14.425 INFO:teuthology.orchestra.run.smithi050.stdout:(22/28): librdkafka-0.11.4-1.el8.x86_64.rpm 8.9 MB/s | 353 kB 00:00 2019-12-19T22:05:14.477 INFO:teuthology.orchestra.run.smithi050.stdout:(23/28): librdmacm-22-2.el8.x86_64.rpm 1.6 MB/s | 70 kB 00:00 2019-12-19T22:05:14.489 INFO:teuthology.orchestra.run.smithi050.stdout:(24/28): rdma-core-22-2.el8.x86_64.rpm 788 kB/s | 53 kB 00:00 2019-12-19T22:05:14.506 INFO:teuthology.orchestra.run.smithi050.stdout:(25/28): userspace-rcu-0.10.1-2.el8.x86_64.rpm 3.2 MB/s | 101 kB 00:00 2019-12-19T22:05:14.523 INFO:teuthology.orchestra.run.smithi050.stdout:(26/28): librabbitmq-0.9.0-1.el8.x86_64.rpm 1.3 MB/s | 47 kB 00:00 2019-12-19T22:05:14.541 INFO:teuthology.orchestra.run.smithi050.stdout:(27/28): libibverbs-22-2.el8.x86_64.rpm 6.7 MB/s | 237 kB 00:00 2019-12-19T22:05:14.813 INFO:teuthology.orchestra.run.smithi050.stdout:(28/28): ceph-common-15.0.0-8663.g368c5a4.el8.x 8.0 MB/s | 20 MB 00:02 2019-12-19T22:05:14.815 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2019-12-19T22:05:14.815 INFO:teuthology.orchestra.run.smithi050.stdout:Total 19 MB/s | 46 MB 00:02 2019-12-19T22:05:14.822 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2019-12-19T22:05:14.876 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2019-12-19T22:05:14.876 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2019-12-19T22:05:15.183 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2019-12-19T22:05:15.183 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2019-12-19T22:05:16.236 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2019-12-19T22:05:16.383 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/28 2019-12-19T22:05:16.579 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librabbitmq-0.9.0-1.el8.x86_64 2/28 2019-12-19T22:05:16.770 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 3/28 2019-12-19T22:05:16.838 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 3/28 2019-12-19T22:05:17.061 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rdma-core-22-2.el8.x86_64 4/28 2019-12-19T22:05:17.287 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libibverbs-22-2.el8.x86_64 5/28 2019-12-19T22:05:17.359 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libibverbs-22-2.el8.x86_64 5/28 2019-12-19T22:05:17.512 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librdmacm-22-2.el8.x86_64 6/28 2019-12-19T22:05:17.574 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librdmacm-22-2.el8.x86_64 6/28 2019-12-19T22:05:17.710 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ceph-argparse-2:15.0.0-8663.g368c5a4.el8.x 7/28 2019-12-19T22:05:17.895 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : userspace-rcu-0.10.1-2.el8.x86_64 8/28 2019-12-19T22:05:17.999 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: userspace-rcu-0.10.1-2.el8.x86_64 8/28 2019-12-19T22:05:18.195 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 9/28 2019-12-19T22:05:18.605 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 9/28 2019-12-19T22:05:18.770 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librados2-2:15.0.0-8663.g368c5a4.el8.x86_64 10/28 2019-12-19T22:05:18.867 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados2-2:15.0.0-8663.g368c5a4.el8.x86_64 10/28 2019-12-19T22:05:19.093 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rados-2:15.0.0-8663.g368c5a4.el8.x86_64 11/28 2019-12-19T22:05:19.253 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephfs2-2:15.0.0-8663.g368c5a4.el8.x86_64 12/28 2019-12-19T22:05:19.482 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libcephfs2-2:15.0.0-8663.g368c5a4.el8.x86_64 12/28 2019-12-19T22:05:19.645 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librbd1-2:15.0.0-8663.g368c5a4.el8.x86_64 13/28 2019-12-19T22:05:20.229 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librbd1-2:15.0.0-8663.g368c5a4.el8.x86_64 13/28 2019-12-19T22:05:20.385 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librgw2-2:15.0.0-8663.g368c5a4.el8.x86_64 14/28 2019-12-19T22:05:20.455 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librgw2-2:15.0.0-8663.g368c5a4.el8.x86_64 14/28 2019-12-19T22:05:20.626 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rgw-2:15.0.0-8663.g368c5a4.el8.x86_64 15/28 2019-12-19T22:05:20.803 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rbd-2:15.0.0-8663.g368c5a4.el8.x86_64 16/28 2019-12-19T22:05:20.989 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cephfs-2:15.0.0-8663.g368c5a4.el8.x86_64 17/28 2019-12-19T22:05:21.136 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libradosstriper1-2:15.0.0-8663.g368c5a4.el8.x86_64 18/28 2019-12-19T22:05:21.206 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libradosstriper1-2:15.0.0-8663.g368c5a4.el8.x86_64 18/28 2019-12-19T22:05:21.361 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 19/28 2019-12-19T22:05:21.527 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libbabeltrace-1.5.6-2.el8.x86_64 20/28 2019-12-19T22:05:21.734 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 21/28 2019-12-19T22:05:21.904 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 22/28 2019-12-19T22:05:22.096 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : leveldb-1.21-2.el8.x86_64 23/28 2019-12-19T22:05:22.220 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ceph-common-2:15.0.0-8663.g368c5a4.el8.x86 24/28 2019-12-19T22:05:25.365 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-common-2:15.0.0-8663.g368c5a4.el8.x86_64 25/28 2019-12-19T22:05:25.553 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-common-2:15.0.0-8663.g368c5a4.el8.x86_64 25/28 2019-12-19T22:05:26.250 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-common-2:15.0.0-8663.g368c5a4.el8.x86_64 25/28 2019-12-19T22:05:26.478 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-base-2:15.0.0-8663.g368c5a4.el8.x86_64 26/28 2019-12-19T22:05:26.582 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-base-2:15.0.0-8663.g368c5a4.el8.x86_64 26/28 2019-12-19T22:05:26.677 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-selinux-2:15.0.0-8663.g368c5a4.el8.x86_64 27/28 2019-12-19T22:05:43.328 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-selinux-2:15.0.0-8663.g368c5a4.el8.x86_64 27/28 2019-12-19T22:05:43.329 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /sys 2019-12-19T22:05:43.329 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /proc 2019-12-19T22:05:43.329 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /dev 2019-12-19T22:05:43.329 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /run 2019-12-19T22:05:43.329 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /mnt 2019-12-19T22:05:43.329 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /var/tmp 2019-12-19T22:05:43.329 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /home 2019-12-19T22:05:43.330 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /tmp 2019-12-19T22:05:43.330 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /dev 2019-12-19T22:05:43.330 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:05:44.159 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-radosgw-2:15.0.0-8663.g368c5a4.el8.x86_64 28/28 2019-12-19T22:05:44.534 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-radosgw-2:15.0.0-8663.g368c5a4.el8.x86_64 28/28 2019-12-19T22:05:44.535 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-base-2:15.0.0-8663.g368c5a4.el8.x86_64 1/28 2019-12-19T22:05:44.535 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-common-2:15.0.0-8663.g368c5a4.el8.x86_64 2/28 2019-12-19T22:05:44.535 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-radosgw-2:15.0.0-8663.g368c5a4.el8.x86_64 3/28 2019-12-19T22:05:44.535 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-selinux-2:15.0.0-8663.g368c5a4.el8.x86_64 4/28 2019-12-19T22:05:44.535 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephfs2-2:15.0.0-8663.g368c5a4.el8.x86_64 5/28 2019-12-19T22:05:44.535 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados2-2:15.0.0-8663.g368c5a4.el8.x86_64 6/28 2019-12-19T22:05:44.536 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libradosstriper1-2:15.0.0-8663.g368c5a4.el8.x86_64 7/28 2019-12-19T22:05:44.536 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librbd1-2:15.0.0-8663.g368c5a4.el8.x86_64 8/28 2019-12-19T22:05:44.536 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librgw2-2:15.0.0-8663.g368c5a4.el8.x86_64 9/28 2019-12-19T22:05:44.536 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ceph-argparse-2:15.0.0-8663.g368c5a4.el8.x 10/28 2019-12-19T22:05:44.536 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ceph-common-2:15.0.0-8663.g368c5a4.el8.x86 11/28 2019-12-19T22:05:44.536 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cephfs-2:15.0.0-8663.g368c5a4.el8.x86_64 12/28 2019-12-19T22:05:44.536 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rados-2:15.0.0-8663.g368c5a4.el8.x86_64 13/28 2019-12-19T22:05:44.536 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rbd-2:15.0.0-8663.g368c5a4.el8.x86_64 14/28 2019-12-19T22:05:44.537 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rgw-2:15.0.0-8663.g368c5a4.el8.x86_64 15/28 2019-12-19T22:05:44.537 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 16/28 2019-12-19T22:05:44.537 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 17/28 2019-12-19T22:05:44.537 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 18/28 2019-12-19T22:05:44.537 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : leveldb-1.21-2.el8.x86_64 19/28 2019-12-19T22:05:44.537 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libbabeltrace-1.5.6-2.el8.x86_64 20/28 2019-12-19T22:05:44.537 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 21/28 2019-12-19T22:05:44.538 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 22/28 2019-12-19T22:05:44.538 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 23/28 2019-12-19T22:05:44.538 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rdma-core-22-2.el8.x86_64 24/28 2019-12-19T22:05:44.538 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librdmacm-22-2.el8.x86_64 25/28 2019-12-19T22:05:44.538 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : userspace-rcu-0.10.1-2.el8.x86_64 26/28 2019-12-19T22:05:44.538 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librabbitmq-0.9.0-1.el8.x86_64 27/28 2019-12-19T22:05:45.376 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libibverbs-22-2.el8.x86_64 28/28 2019-12-19T22:05:45.376 INFO:teuthology.orchestra.run.smithi050.stdout:Installed products updated. 2019-12-19T22:05:47.817 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:05:47.818 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2019-12-19T22:05:47.818 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-radosgw-2:15.0.0-8663.g368c5a4.el8.x86_64 2019-12-19T22:05:47.818 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base-2:15.0.0-8663.g368c5a4.el8.x86_64 2019-12-19T22:05:47.818 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-common-2:15.0.0-8663.g368c5a4.el8.x86_64 2019-12-19T22:05:47.818 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-selinux-2:15.0.0-8663.g368c5a4.el8.x86_64 2019-12-19T22:05:47.818 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs2-2:15.0.0-8663.g368c5a4.el8.x86_64 2019-12-19T22:05:47.819 INFO:teuthology.orchestra.run.smithi050.stdout: librados2-2:15.0.0-8663.g368c5a4.el8.x86_64 2019-12-19T22:05:47.819 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1-2:15.0.0-8663.g368c5a4.el8.x86_64 2019-12-19T22:05:47.819 INFO:teuthology.orchestra.run.smithi050.stdout: librbd1-2:15.0.0-8663.g368c5a4.el8.x86_64 2019-12-19T22:05:47.819 INFO:teuthology.orchestra.run.smithi050.stdout: librgw2-2:15.0.0-8663.g368c5a4.el8.x86_64 2019-12-19T22:05:47.819 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse-2:15.0.0-8663.g368c5a4.el8.x86_64 2019-12-19T22:05:47.819 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common-2:15.0.0-8663.g368c5a4.el8.x86_64 2019-12-19T22:05:47.820 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cephfs-2:15.0.0-8663.g368c5a4.el8.x86_64 2019-12-19T22:05:47.820 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rados-2:15.0.0-8663.g368c5a4.el8.x86_64 2019-12-19T22:05:47.820 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rbd-2:15.0.0-8663.g368c5a4.el8.x86_64 2019-12-19T22:05:47.820 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rgw-2:15.0.0-8663.g368c5a4.el8.x86_64 2019-12-19T22:05:47.820 INFO:teuthology.orchestra.run.smithi050.stdout: gperftools-libs-2.7-6.el8.x86_64 2019-12-19T22:05:47.820 INFO:teuthology.orchestra.run.smithi050.stdout: liboath-2.6.2-3.el8.x86_64 2019-12-19T22:05:47.821 INFO:teuthology.orchestra.run.smithi050.stdout: libunwind-1.3.1-3.el8.x86_64 2019-12-19T22:05:47.821 INFO:teuthology.orchestra.run.smithi050.stdout: leveldb-1.21-2.el8.x86_64 2019-12-19T22:05:47.821 INFO:teuthology.orchestra.run.smithi050.stdout: libbabeltrace-1.5.6-2.el8.x86_64 2019-12-19T22:05:47.821 INFO:teuthology.orchestra.run.smithi050.stdout: lttng-ust-2.8.1-11.el8.x86_64 2019-12-19T22:05:47.826 INFO:teuthology.orchestra.run.smithi050.stdout: python3-prettytable-0.7.2-14.el8.noarch 2019-12-19T22:05:47.827 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka-0.11.4-1.el8.x86_64 2019-12-19T22:05:47.827 INFO:teuthology.orchestra.run.smithi050.stdout: rdma-core-22-2.el8.x86_64 2019-12-19T22:05:47.827 INFO:teuthology.orchestra.run.smithi050.stdout: librdmacm-22-2.el8.x86_64 2019-12-19T22:05:47.827 INFO:teuthology.orchestra.run.smithi050.stdout: userspace-rcu-0.10.1-2.el8.x86_64 2019-12-19T22:05:47.827 INFO:teuthology.orchestra.run.smithi050.stdout: librabbitmq-0.9.0-1.el8.x86_64 2019-12-19T22:05:47.827 INFO:teuthology.orchestra.run.smithi050.stdout: libibverbs-22-2.el8.x86_64 2019-12-19T22:05:47.828 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:05:47.828 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2019-12-19T22:05:47.993 INFO:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-test 2019-12-19T22:05:48.355 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2019-12-19T22:05:48.937 INFO:teuthology.orchestra.run.smithi050.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 66 kB/s | 2.8 kB 00:00 2019-12-19T22:05:49.008 INFO:teuthology.orchestra.run.smithi050.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 56 kB/s | 2.3 kB 00:00 2019-12-19T22:05:49.531 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2019-12-19T22:05:49.532 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:05:49.533 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2019-12-19T22:05:49.533 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:05:49.533 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2019-12-19T22:05:49.533 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-test x86_64 2:15.0.0-8663.g368c5a4.el8 2019-12-19T22:05:49.533 INFO:teuthology.orchestra.run.smithi050.stdout: ceph 34 M 2019-12-19T22:05:49.533 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2019-12-19T22:05:49.534 INFO:teuthology.orchestra.run.smithi050.stdout: xmlstarlet x86_64 1.6.1-13.el8 lab-extras 69 k 2019-12-19T22:05:49.534 INFO:teuthology.orchestra.run.smithi050.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2019-12-19T22:05:49.534 INFO:teuthology.orchestra.run.smithi050.stdout: socat x86_64 1.7.3.2-6.el8 rhel-8-for-x86_64-appstream-rpms 298 k 2019-12-19T22:05:49.534 INFO:teuthology.orchestra.run.smithi050.stdout: oniguruma x86_64 6.8.2-1.el8 rhel-8-for-x86_64-appstream-rpms 188 k 2019-12-19T22:05:49.534 INFO:teuthology.orchestra.run.smithi050.stdout: libxslt x86_64 1.1.32-3.el8 rhel-8-for-x86_64-baseos-rpms 249 k 2019-12-19T22:05:49.534 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:05:49.534 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2019-12-19T22:05:49.535 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:05:49.535 INFO:teuthology.orchestra.run.smithi050.stdout:Install 6 Packages 2019-12-19T22:05:49.535 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:05:49.535 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 35 M 2019-12-19T22:05:49.536 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 150 M 2019-12-19T22:05:49.536 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2019-12-19T22:05:49.542 INFO:teuthology.orchestra.run.smithi050.stdout:(1/6): xmlstarlet-1.6.1-13.el8.x86_64.rpm 15 MB/s | 69 kB 00:00 2019-12-19T22:05:49.604 INFO:teuthology.orchestra.run.smithi050.stdout:(2/6): jq-1.5-12.el8.x86_64.rpm 2.3 MB/s | 161 kB 00:00 2019-12-19T22:05:49.606 INFO:teuthology.orchestra.run.smithi050.stdout:(3/6): socat-1.7.3.2-6.el8.x86_64.rpm 5.0 MB/s | 298 kB 00:00 2019-12-19T22:05:49.648 INFO:teuthology.orchestra.run.smithi050.stdout:(4/6): oniguruma-6.8.2-1.el8.x86_64.rpm 4.2 MB/s | 188 kB 00:00 2019-12-19T22:05:49.667 INFO:teuthology.orchestra.run.smithi050.stdout:(5/6): libxslt-1.1.32-3.el8.x86_64.rpm 4.0 MB/s | 249 kB 00:00 2019-12-19T22:05:52.064 INFO:teuthology.orchestra.run.smithi050.stdout:(6/6): ceph-test-15.0.0-8663.g368c5a4.el8.x86_6 13 MB/s | 34 MB 00:02 2019-12-19T22:05:52.064 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2019-12-19T22:05:52.065 INFO:teuthology.orchestra.run.smithi050.stdout:Total 14 MB/s | 35 MB 00:02 2019-12-19T22:05:52.070 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2019-12-19T22:05:52.093 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2019-12-19T22:05:52.094 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2019-12-19T22:05:52.585 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2019-12-19T22:05:52.585 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2019-12-19T22:05:53.192 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2019-12-19T22:05:53.392 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libxslt-1.1.32-3.el8.x86_64 1/6 2019-12-19T22:05:53.562 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : xmlstarlet-1.6.1-13.el8.x86_64 2/6 2019-12-19T22:05:53.732 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : oniguruma-6.8.2-1.el8.x86_64 3/6 2019-12-19T22:05:53.815 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: oniguruma-6.8.2-1.el8.x86_64 3/6 2019-12-19T22:05:54.045 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : jq-1.5-12.el8.x86_64 4/6 2019-12-19T22:05:57.574 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : socat-1.7.3.2-6.el8.x86_64 5/6 2019-12-19T22:05:58.611 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-test-2:15.0.0-8663.g368c5a4.el8.x86_64 6/6 2019-12-19T22:05:59.126 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-test-2:15.0.0-8663.g368c5a4.el8.x86_64 6/6 2019-12-19T22:05:59.126 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-test-2:15.0.0-8663.g368c5a4.el8.x86_64 1/6 2019-12-19T22:05:59.126 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xmlstarlet-1.6.1-13.el8.x86_64 2/6 2019-12-19T22:05:59.127 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : jq-1.5-12.el8.x86_64 3/6 2019-12-19T22:05:59.127 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : socat-1.7.3.2-6.el8.x86_64 4/6 2019-12-19T22:05:59.127 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : oniguruma-6.8.2-1.el8.x86_64 5/6 2019-12-19T22:05:59.524 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libxslt-1.1.32-3.el8.x86_64 6/6 2019-12-19T22:05:59.524 INFO:teuthology.orchestra.run.smithi050.stdout:Installed products updated. 2019-12-19T22:06:02.555 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:06:02.555 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2019-12-19T22:06:02.555 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-test-2:15.0.0-8663.g368c5a4.el8.x86_64 xmlstarlet-1.6.1-13.el8.x86_64 2019-12-19T22:06:02.555 INFO:teuthology.orchestra.run.smithi050.stdout: jq-1.5-12.el8.x86_64 socat-1.7.3.2-6.el8.x86_64 2019-12-19T22:06:02.556 INFO:teuthology.orchestra.run.smithi050.stdout: oniguruma-6.8.2-1.el8.x86_64 libxslt-1.1.32-3.el8.x86_64 2019-12-19T22:06:02.556 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:06:02.556 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2019-12-19T22:06:02.700 INFO:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph 2019-12-19T22:06:03.055 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2019-12-19T22:06:03.750 INFO:teuthology.orchestra.run.smithi050.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 66 kB/s | 2.8 kB 00:00 2019-12-19T22:06:03.821 INFO:teuthology.orchestra.run.smithi050.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 58 kB/s | 2.3 kB 00:00 2019-12-19T22:06:04.354 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2019-12-19T22:06:04.358 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:06:04.358 INFO:teuthology.orchestra.run.smithi050.stdout: Package ArchVersion Repository Size 2019-12-19T22:06:04.358 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:06:04.358 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2019-12-19T22:06:04.358 INFO:teuthology.orchestra.run.smithi050.stdout: ceph x86_642:15.0.0-8663.g368c5a4.el8 ceph 6.4 k 2019-12-19T22:06:04.358 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2019-12-19T22:06:04.359 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mds x86_642:15.0.0-8663.g368c5a4.el8 ceph 2.0 M 2019-12-19T22:06:04.359 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr x86_642:15.0.0-8663.g368c5a4.el8 ceph 1.5 M 2019-12-19T22:06:04.359 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mon x86_642:15.0.0-8663.g368c5a4.el8 ceph 4.3 M 2019-12-19T22:06:04.359 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-osd x86_642:15.0.0-8663.g368c5a4.el8 ceph 17 M 2019-12-19T22:06:04.359 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cheroot noarch8.2.1-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 145 k 2019-12-19T22:06:04.359 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy noarch18.4.0-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 385 k 2019-12-19T22:06:04.359 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco noarch6.2-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 11 k 2019-12-19T22:06:04.360 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-functools noarch2.0-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 18 k 2019-12-19T22:06:04.360 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils noarch0.3.5-11.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 49 k 2019-12-19T22:06:04.360 INFO:teuthology.orchestra.run.smithi050.stdout: python3-more-itertools noarch7.2.0-3.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 59 k 2019-12-19T22:06:04.360 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan noarch1.3.2-9.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 283 k 2019-12-19T22:06:04.360 INFO:teuthology.orchestra.run.smithi050.stdout: python3-portend noarch2.6-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 16 k 2019-12-19T22:06:04.360 INFO:teuthology.orchestra.run.smithi050.stdout: python3-simplegeneric noarch0.8.1-17.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 19 k 2019-12-19T22:06:04.360 INFO:teuthology.orchestra.run.smithi050.stdout: python3-singledispatch noarch3.4.0.3-18.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 24 k 2019-12-19T22:06:04.361 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempora noarch1.14.1-5.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 30 k 2019-12-19T22:06:04.361 INFO:teuthology.orchestra.run.smithi050.stdout: python3-trustme noarch0.5.2-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 27 k 2019-12-19T22:06:04.361 INFO:teuthology.orchestra.run.smithi050.stdout: python3-zc-lockfile noarch2.0-2.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 23 k 2019-12-19T22:06:04.361 INFO:teuthology.orchestra.run.smithi050.stdout: python3-bcrypt x86_643.1.6-2.el8.1 epel 44 k 2019-12-19T22:06:04.361 INFO:teuthology.orchestra.run.smithi050.stdout: python3-beautifulsoup4 noarch4.6.3-2.el8.1 epel 185 k 2019-12-19T22:06:04.361 INFO:teuthology.orchestra.run.smithi050.stdout: python3-waitress noarch1.2.1-2.el8.1 epel 241 k 2019-12-19T22:06:04.361 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob noarch1.8.5-1.el8.1 epel 251 k 2019-12-19T22:06:04.362 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webtest noarch2.0.33-1.el8 epel 85 k 2019-12-19T22:06:04.362 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webencodings noarch0.5.1-6.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2019-12-19T22:06:04.362 INFO:teuthology.orchestra.run.smithi050.stdout: python3-lxml x86_644.2.3-1.el8 rhel-8-for-x86_64-appstream-rpms 1.5 M 2019-12-19T22:06:04.362 INFO:teuthology.orchestra.run.smithi050.stdout: python3-werkzeug noarch0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2019-12-19T22:06:04.362 INFO:teuthology.orchestra.run.smithi050.stdout: python3-mako noarch1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2019-12-19T22:06:04.362 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytz noarch2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2019-12-19T22:06:04.362 INFO:teuthology.orchestra.run.smithi050.stdout: python3-markupsafe x86_640.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2019-12-19T22:06:04.363 INFO:teuthology.orchestra.run.smithi050.stdout:Installing weak dependencies: 2019-12-19T22:06:04.363 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cssselect noarch0.9.2-10.el8 epel 40 k 2019-12-19T22:06:04.363 INFO:teuthology.orchestra.run.smithi050.stdout: python3-html5lib noarch1:0.999999999-6.el8 rhel-8-for-x86_64-appstream-rpms 214 k 2019-12-19T22:06:04.363 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:06:04.363 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2019-12-19T22:06:04.363 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:06:04.363 INFO:teuthology.orchestra.run.smithi050.stdout:Install 31 Packages 2019-12-19T22:06:04.364 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:06:04.364 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 29 M 2019-12-19T22:06:04.364 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 102 M 2019-12-19T22:06:04.364 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2019-12-19T22:06:04.540 INFO:teuthology.orchestra.run.smithi050.stdout:(1/31): ceph-15.0.0-8663.g368c5a4.el8.x86_64.rp 67 kB/s | 6.4 kB 00:00 2019-12-19T22:06:04.826 INFO:teuthology.orchestra.run.smithi050.stdout:(2/31): ceph-mgr-15.0.0-8663.g368c5a4.el8.x86_6 4.0 MB/s | 1.5 MB 00:00 2019-12-19T22:06:04.869 INFO:teuthology.orchestra.run.smithi050.stdout:(3/31): ceph-mds-15.0.0-8663.g368c5a4.el8.x86_6 4.7 MB/s | 2.0 MB 00:00 2019-12-19T22:06:05.091 INFO:teuthology.orchestra.run.smithi050.stdout:(4/31): ceph-mon-15.0.0-8663.g368c5a4.el8.x86_6 7.9 MB/s | 4.3 MB 00:00 2019-12-19T22:06:05.265 INFO:teuthology.orchestra.run.smithi050.stdout:(5/31): python3-cheroot-8.2.1-1.el8.noarch.rpm 369 kB/s | 145 kB 00:00 2019-12-19T22:06:05.323 INFO:teuthology.orchestra.run.smithi050.stdout:(6/31): python3-jaraco-6.2-6.el8.noarch.rpm 186 kB/s | 11 kB 00:00 2019-12-19T22:06:05.387 INFO:teuthology.orchestra.run.smithi050.stdout:(7/31): python3-jaraco-functools-2.0-4.el8.noar 281 kB/s | 18 kB 00:00 2019-12-19T22:06:05.452 INFO:teuthology.orchestra.run.smithi050.stdout:(8/31): python3-logutils-0.3.5-11.el8.noarch.rp 763 kB/s | 49 kB 00:00 2019-12-19T22:06:05.518 INFO:teuthology.orchestra.run.smithi050.stdout:(9/31): python3-more-itertools-7.2.0-3.el8.noar 892 kB/s | 59 kB 00:00 2019-12-19T22:06:05.646 INFO:teuthology.orchestra.run.smithi050.stdout:(10/31): python3-pecan-1.3.2-9.el8.noarch.rpm 2.2 MB/s | 283 kB 00:00 2019-12-19T22:06:05.648 INFO:teuthology.orchestra.run.smithi050.stdout:(11/31): python3-cherrypy-18.4.0-1.el8.noarch.r 691 kB/s | 385 kB 00:00 2019-12-19T22:06:05.708 INFO:teuthology.orchestra.run.smithi050.stdout:(12/31): python3-portend-2.6-1.el8.noarch.rpm 257 kB/s | 16 kB 00:00 2019-12-19T22:06:05.720 INFO:teuthology.orchestra.run.smithi050.stdout:(13/31): python3-simplegeneric-0.8.1-17.el8.noa 268 kB/s | 19 kB 00:00 2019-12-19T22:06:05.770 INFO:teuthology.orchestra.run.smithi050.stdout:(14/31): python3-singledispatch-3.4.0.3-18.el8. 391 kB/s | 24 kB 00:00 2019-12-19T22:06:05.792 INFO:teuthology.orchestra.run.smithi050.stdout:(15/31): python3-tempora-1.14.1-5.el8.noarch.rp 412 kB/s | 30 kB 00:00 2019-12-19T22:06:05.835 INFO:teuthology.orchestra.run.smithi050.stdout:(16/31): python3-trustme-0.5.2-4.el8.noarch.rpm 414 kB/s | 27 kB 00:00 2019-12-19T22:06:05.867 INFO:teuthology.orchestra.run.smithi050.stdout:(17/31): python3-zc-lockfile-2.0-2.el8.noarch.r 326 kB/s | 23 kB 00:00 2019-12-19T22:06:06.063 INFO:teuthology.orchestra.run.smithi050.stdout:(18/31): ceph-osd-15.0.0-8663.g368c5a4.el8.x86_ 13 MB/s | 17 MB 00:01 2019-12-19T22:06:06.166 INFO:teuthology.orchestra.run.smithi050.stdout:(19/31): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 132 kB/s | 44 kB 00:00 2019-12-19T22:06:06.235 INFO:teuthology.orchestra.run.smithi050.stdout:(20/31): python3-beautifulsoup4-4.6.3-2.el8.1.n 499 kB/s | 185 kB 00:00 2019-12-19T22:06:06.267 INFO:teuthology.orchestra.run.smithi050.stdout:(21/31): python3-cssselect-0.9.2-10.el8.noarch. 197 kB/s | 40 kB 00:00 2019-12-19T22:06:06.307 INFO:teuthology.orchestra.run.smithi050.stdout:(22/31): python3-waitress-1.2.1-2.el8.1.noarch. 1.8 MB/s | 241 kB 00:00 2019-12-19T22:06:06.338 INFO:teuthology.orchestra.run.smithi050.stdout:(23/31): python3-webtest-2.0.33-1.el8.noarch.rp 1.2 MB/s | 85 kB 00:00 2019-12-19T22:06:06.351 INFO:teuthology.orchestra.run.smithi050.stdout:(24/31): python3-webencodings-0.5.1-6.el8.noarc 538 kB/s | 27 kB 00:00 2019-12-19T22:06:06.352 INFO:teuthology.orchestra.run.smithi050.stdout:(25/31): python3-webob-1.8.5-1.el8.1.noarch.rpm 2.1 MB/s | 251 kB 00:00 2019-12-19T22:06:06.416 INFO:teuthology.orchestra.run.smithi050.stdout:(26/31): python3-werkzeug-0.12.2-4.el8.noarch.r 7.1 MB/s | 457 kB 00:00 2019-12-19T22:06:06.425 INFO:teuthology.orchestra.run.smithi050.stdout:(27/31): python3-lxml-4.2.3-1.el8.x86_64.rpm 17 MB/s | 1.5 MB 00:00 2019-12-19T22:06:06.434 INFO:teuthology.orchestra.run.smithi050.stdout:(28/31): python3-mako-1.0.6-13.el8.noarch.rpm 1.9 MB/s | 157 kB 00:00 2019-12-19T22:06:06.459 INFO:teuthology.orchestra.run.smithi050.stdout:(29/31): python3-html5lib-0.999999999-6.el8.noa 4.8 MB/s | 214 kB 00:00 2019-12-19T22:06:06.486 INFO:teuthology.orchestra.run.smithi050.stdout:(30/31): python3-pytz-2017.2-9.el8.noarch.rpm 1.0 MB/s | 54 kB 00:00 2019-12-19T22:06:06.487 INFO:teuthology.orchestra.run.smithi050.stdout:(31/31): python3-markupsafe-0.23-19.el8.x86_64. 732 kB/s | 39 kB 00:00 2019-12-19T22:06:06.492 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2019-12-19T22:06:06.492 INFO:teuthology.orchestra.run.smithi050.stdout:Total 13 MB/s | 29 MB 00:02 2019-12-19T22:06:06.493 INFO:teuthology.orchestra.run.smithi050.stderr:warning: /var/cache/dnf/copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8-ac801414381f5e61/packages/python3-cheroot-8.2.1-1.el8.noarch.rpm: Header V3 RSA/SHA1 Signature, key ID 2a8a41ec: NOKEY 2019-12-19T22:06:06.727 INFO:teuthology.orchestra.run.smithi050.stdout:Copr repo for ceph-el8 owned by ktdreyer 4.2 kB/s | 1.0 kB 00:00 2019-12-19T22:06:06.839 INFO:teuthology.orchestra.run.smithi050.stderr:Importing GPG key 0x2A8A41EC: 2019-12-19T22:06:06.839 INFO:teuthology.orchestra.run.smithi050.stderr: Userid : "ktdreyer_ceph-el8 (None) " 2019-12-19T22:06:06.839 INFO:teuthology.orchestra.run.smithi050.stderr: Fingerprint: 64D3 346F FD63 5D2D B5D0 5873 1014 BDBE 2A8A 41EC 2019-12-19T22:06:06.839 INFO:teuthology.orchestra.run.smithi050.stderr: From : https://copr-be.cloud.fedoraproject.org/results/ktdreyer/ceph-el8/pubkey.gpg 2019-12-19T22:06:06.930 INFO:teuthology.orchestra.run.smithi050.stdout:Key imported successfully 2019-12-19T22:06:06.953 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2019-12-19T22:06:06.990 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2019-12-19T22:06:06.990 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2019-12-19T22:06:07.290 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2019-12-19T22:06:07.291 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2019-12-19T22:06:08.433 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2019-12-19T22:06:08.618 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 1/31 2019-12-19T22:06:08.794 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 2/31 2019-12-19T22:06:09.012 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 3/31 2019-12-19T22:06:09.241 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 4/31 2019-12-19T22:06:09.487 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 5/31 2019-12-19T22:06:09.700 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 6/31 2019-12-19T22:06:09.911 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 7/31 2019-12-19T22:06:10.197 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 8/31 2019-12-19T22:06:10.366 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 9/31 2019-12-19T22:06:10.708 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 10/31 2019-12-19T22:06:11.016 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 11/31 2019-12-19T22:06:11.240 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 12/31 2019-12-19T22:06:11.416 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 13/31 2019-12-19T22:06:11.611 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 14/31 2019-12-19T22:06:11.763 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 15/31 2019-12-19T22:06:11.947 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-trustme-0.5.2-4.el8.noarch 16/31 2019-12-19T22:06:12.093 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 17/31 2019-12-19T22:06:12.257 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 18/31 2019-12-19T22:06:12.533 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 19/31 2019-12-19T22:06:12.752 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 20/31 2019-12-19T22:06:12.877 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 21/31 2019-12-19T22:06:13.070 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 22/31 2019-12-19T22:06:13.233 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 23/31 2019-12-19T22:06:13.385 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 24/31 2019-12-19T22:06:13.621 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-portend-2.6-1.el8.noarch 25/31 2019-12-19T22:06:14.016 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 26/31 2019-12-19T22:06:14.188 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-2:15.0.0-8663.g368c5a4.el8.x86_64 27/31 2019-12-19T22:06:15.684 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-2:15.0.0-8663.g368c5a4.el8.x86_64 27/31 2019-12-19T22:06:15.821 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-osd-2:15.0.0-8663.g368c5a4.el8.x86_64 28/31 2019-12-19T22:06:16.233 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-osd-2:15.0.0-8663.g368c5a4.el8.x86_64 28/31 2019-12-19T22:06:16.429 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mon-2:15.0.0-8663.g368c5a4.el8.x86_64 29/31 2019-12-19T22:06:16.630 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mon-2:15.0.0-8663.g368c5a4.el8.x86_64 29/31 2019-12-19T22:06:16.771 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mds-2:15.0.0-8663.g368c5a4.el8.x86_64 30/31 2019-12-19T22:06:16.790 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mds-2:15.0.0-8663.g368c5a4.el8.x86_64 30/31 2019-12-19T22:06:16.886 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-2:15.0.0-8663.g368c5a4.el8.x86_64 31/31 2019-12-19T22:06:17.205 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-2:15.0.0-8663.g368c5a4.el8.x86_64 31/31 2019-12-19T22:06:17.205 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-2:15.0.0-8663.g368c5a4.el8.x86_64 1/31 2019-12-19T22:06:17.205 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mds-2:15.0.0-8663.g368c5a4.el8.x86_64 2/31 2019-12-19T22:06:17.206 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-2:15.0.0-8663.g368c5a4.el8.x86_64 3/31 2019-12-19T22:06:17.206 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mon-2:15.0.0-8663.g368c5a4.el8.x86_64 4/31 2019-12-19T22:06:17.206 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-osd-2:15.0.0-8663.g368c5a4.el8.x86_64 5/31 2019-12-19T22:06:17.206 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 6/31 2019-12-19T22:06:17.206 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 7/31 2019-12-19T22:06:17.206 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 8/31 2019-12-19T22:06:17.206 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 9/31 2019-12-19T22:06:17.207 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 10/31 2019-12-19T22:06:17.207 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 11/31 2019-12-19T22:06:17.207 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 12/31 2019-12-19T22:06:17.207 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-portend-2.6-1.el8.noarch 13/31 2019-12-19T22:06:17.207 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 14/31 2019-12-19T22:06:17.207 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 15/31 2019-12-19T22:06:17.208 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 16/31 2019-12-19T22:06:17.208 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-trustme-0.5.2-4.el8.noarch 17/31 2019-12-19T22:06:17.208 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 18/31 2019-12-19T22:06:17.208 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 19/31 2019-12-19T22:06:17.210 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 20/31 2019-12-19T22:06:17.210 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 21/31 2019-12-19T22:06:17.210 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 22/31 2019-12-19T22:06:17.210 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 23/31 2019-12-19T22:06:17.211 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 24/31 2019-12-19T22:06:17.211 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 25/31 2019-12-19T22:06:17.211 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 26/31 2019-12-19T22:06:17.211 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 27/31 2019-12-19T22:06:17.211 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 28/31 2019-12-19T22:06:17.211 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 29/31 2019-12-19T22:06:17.212 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 30/31 2019-12-19T22:06:18.022 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 31/31 2019-12-19T22:06:18.022 INFO:teuthology.orchestra.run.smithi050.stdout:Installed products updated. 2019-12-19T22:06:19.881 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:06:19.881 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2019-12-19T22:06:19.881 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-2:15.0.0-8663.g368c5a4.el8.x86_64 2019-12-19T22:06:19.881 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cssselect-0.9.2-10.el8.noarch 2019-12-19T22:06:19.881 INFO:teuthology.orchestra.run.smithi050.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2019-12-19T22:06:19.882 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mds-2:15.0.0-8663.g368c5a4.el8.x86_64 2019-12-19T22:06:19.882 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-2:15.0.0-8663.g368c5a4.el8.x86_64 2019-12-19T22:06:19.882 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mon-2:15.0.0-8663.g368c5a4.el8.x86_64 2019-12-19T22:06:19.882 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-osd-2:15.0.0-8663.g368c5a4.el8.x86_64 2019-12-19T22:06:19.882 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cheroot-8.2.1-1.el8.noarch 2019-12-19T22:06:19.882 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2019-12-19T22:06:19.882 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-6.2-6.el8.noarch 2019-12-19T22:06:19.883 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2019-12-19T22:06:19.883 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils-0.3.5-11.el8.noarch 2019-12-19T22:06:19.883 INFO:teuthology.orchestra.run.smithi050.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2019-12-19T22:06:19.883 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan-1.3.2-9.el8.noarch 2019-12-19T22:06:19.883 INFO:teuthology.orchestra.run.smithi050.stdout: python3-portend-2.6-1.el8.noarch 2019-12-19T22:06:19.883 INFO:teuthology.orchestra.run.smithi050.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2019-12-19T22:06:19.883 INFO:teuthology.orchestra.run.smithi050.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2019-12-19T22:06:19.883 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempora-1.14.1-5.el8.noarch 2019-12-19T22:06:19.884 INFO:teuthology.orchestra.run.smithi050.stdout: python3-trustme-0.5.2-4.el8.noarch 2019-12-19T22:06:19.884 INFO:teuthology.orchestra.run.smithi050.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2019-12-19T22:06:19.884 INFO:teuthology.orchestra.run.smithi050.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2019-12-19T22:06:19.884 INFO:teuthology.orchestra.run.smithi050.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2019-12-19T22:06:19.884 INFO:teuthology.orchestra.run.smithi050.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2019-12-19T22:06:19.884 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob-1.8.5-1.el8.1.noarch 2019-12-19T22:06:19.884 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webtest-2.0.33-1.el8.noarch 2019-12-19T22:06:19.885 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webencodings-0.5.1-6.el8.noarch 2019-12-19T22:06:19.885 INFO:teuthology.orchestra.run.smithi050.stdout: python3-lxml-4.2.3-1.el8.x86_64 2019-12-19T22:06:19.885 INFO:teuthology.orchestra.run.smithi050.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2019-12-19T22:06:19.885 INFO:teuthology.orchestra.run.smithi050.stdout: python3-mako-1.0.6-13.el8.noarch 2019-12-19T22:06:19.885 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytz-2017.2-9.el8.noarch 2019-12-19T22:06:19.885 INFO:teuthology.orchestra.run.smithi050.stdout: python3-markupsafe-0.23-19.el8.x86_64 2019-12-19T22:06:19.885 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:06:19.886 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2019-12-19T22:06:20.062 INFO:teuthology.orchestra.run.smithi050:> sudo yum -y install cephadm 2019-12-19T22:06:20.432 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2019-12-19T22:06:21.096 INFO:teuthology.orchestra.run.smithi050.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 42 kB/s | 2.8 kB 00:00 2019-12-19T22:06:21.186 INFO:teuthology.orchestra.run.smithi050.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 41 kB/s | 2.3 kB 00:00 2019-12-19T22:06:21.708 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2019-12-19T22:06:21.714 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:06:21.715 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2019-12-19T22:06:21.715 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:06:21.715 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2019-12-19T22:06:21.715 INFO:teuthology.orchestra.run.smithi050.stdout: cephadm x86_64 2:15.0.0-8663.g368c5a4.el8 ceph 25 k 2019-12-19T22:06:21.715 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:06:21.715 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2019-12-19T22:06:21.716 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:06:21.716 INFO:teuthology.orchestra.run.smithi050.stdout:Install 1 Package 2019-12-19T22:06:21.716 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:06:21.716 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 25 k 2019-12-19T22:06:21.716 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 82 k 2019-12-19T22:06:21.716 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2019-12-19T22:06:21.821 INFO:teuthology.orchestra.run.smithi050.stdout:cephadm-15.0.0-8663.g368c5a4.el8.x86_64.rpm 226 kB/s | 25 kB 00:00 2019-12-19T22:06:21.822 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2019-12-19T22:06:21.823 INFO:teuthology.orchestra.run.smithi050.stdout:Total 223 kB/s | 25 kB 00:00 2019-12-19T22:06:21.823 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2019-12-19T22:06:21.834 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2019-12-19T22:06:21.835 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2019-12-19T22:06:21.835 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2019-12-19T22:06:21.835 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2019-12-19T22:06:21.874 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2019-12-19T22:06:23.139 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: cephadm-2:15.0.0-8663.g368c5a4.el8.x86_64 1/1 2019-12-19T22:06:23.384 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephadm-2:15.0.0-8663.g368c5a4.el8.x86_64 1/1 2019-12-19T22:06:23.702 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephadm-2:15.0.0-8663.g368c5a4.el8.x86_64 1/1 2019-12-19T22:06:23.703 INFO:teuthology.orchestra.run.smithi050.stdout:Installed products updated. 2019-12-19T22:06:25.325 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:06:25.325 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2019-12-19T22:06:25.325 INFO:teuthology.orchestra.run.smithi050.stdout: cephadm-2:15.0.0-8663.g368c5a4.el8.x86_64 2019-12-19T22:06:25.325 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:06:25.325 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2019-12-19T22:06:25.670 INFO:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-mgr 2019-12-19T22:06:26.051 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2019-12-19T22:06:26.770 INFO:teuthology.orchestra.run.smithi050.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 71 kB/s | 2.8 kB 00:00 2019-12-19T22:06:26.841 INFO:teuthology.orchestra.run.smithi050.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 60 kB/s | 2.3 kB 00:00 2019-12-19T22:06:27.256 INFO:teuthology.orchestra.run.smithi050.stdout:Package ceph-mgr-2:15.0.0-8663.g368c5a4.el8.x86_64 is already installed. 2019-12-19T22:06:27.373 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2019-12-19T22:06:27.375 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2019-12-19T22:06:27.375 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2019-12-19T22:06:27.503 INFO:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-mgr-dashboard 2019-12-19T22:06:27.868 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2019-12-19T22:06:28.762 INFO:teuthology.orchestra.run.smithi050.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 68 kB/s | 2.8 kB 00:00 2019-12-19T22:06:28.834 INFO:teuthology.orchestra.run.smithi050.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 58 kB/s | 2.3 kB 00:00 2019-12-19T22:06:29.352 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2019-12-19T22:06:29.354 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:06:29.354 INFO:teuthology.orchestra.run.smithi050.stdout: Package ArchVersion Repository Size 2019-12-19T22:06:29.355 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:06:29.355 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2019-12-19T22:06:29.355 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard noarch2:15.0.0-8663.g368c5a4.el8 ceph-noarch 3.8 M 2019-12-19T22:06:29.355 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2019-12-19T22:06:29.356 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-grafana-dashboards noarch2:15.0.0-8663.g368c5a4.el8 ceph-noarch 22 k 2019-12-19T22:06:29.356 INFO:teuthology.orchestra.run.smithi050.stdout: python3-repoze-lru noarch0.7-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 34 k 2019-12-19T22:06:29.356 INFO:teuthology.orchestra.run.smithi050.stdout: python3-routes noarch2.4.1-12.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 197 k 2019-12-19T22:06:29.356 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jwt noarch1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2019-12-19T22:06:29.357 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:06:29.357 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2019-12-19T22:06:29.357 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:06:29.357 INFO:teuthology.orchestra.run.smithi050.stdout:Install 5 Packages 2019-12-19T22:06:29.358 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:06:29.358 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 4.1 M 2019-12-19T22:06:29.358 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 18 M 2019-12-19T22:06:29.358 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2019-12-19T22:06:29.471 INFO:teuthology.orchestra.run.smithi050.stdout:(1/5): ceph-grafana-dashboards-15.0.0-8663.g368 195 kB/s | 22 kB 00:00 2019-12-19T22:06:29.677 INFO:teuthology.orchestra.run.smithi050.stdout:(2/5): ceph-mgr-dashboard-15.0.0-8663.g368c5a4. 12 MB/s | 3.8 MB 00:00 2019-12-19T22:06:29.678 INFO:teuthology.orchestra.run.smithi050.stdout:(3/5): python3-repoze-lru-0.7-6.el8.noarch.rpm 105 kB/s | 34 kB 00:00 2019-12-19T22:06:29.757 INFO:teuthology.orchestra.run.smithi050.stdout:(4/5): python3-jwt-1.6.1-2.el8.noarch.rpm 533 kB/s | 43 kB 00:00 2019-12-19T22:06:29.941 INFO:teuthology.orchestra.run.smithi050.stdout:(5/5): python3-routes-2.4.1-12.el8.noarch.rpm 418 kB/s | 197 kB 00:00 2019-12-19T22:06:29.944 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2019-12-19T22:06:29.945 INFO:teuthology.orchestra.run.smithi050.stdout:Total 6.9 MB/s | 4.1 MB 00:00 2019-12-19T22:06:29.948 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2019-12-19T22:06:29.957 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2019-12-19T22:06:29.957 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2019-12-19T22:06:30.069 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2019-12-19T22:06:30.070 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2019-12-19T22:06:30.305 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2019-12-19T22:06:30.483 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 1/5 2019-12-19T22:06:30.687 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 2/5 2019-12-19T22:06:30.868 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 3/5 2019-12-19T22:06:31.882 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-grafana-dashboards-2:15.0.0-8663.g368c5a4.el8.n 4/5 2019-12-19T22:06:32.085 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-dashboard-2:15.0.0-8663.g368c5a4.el8.noarch 5/5 2019-12-19T22:06:32.277 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-dashboard-2:15.0.0-8663.g368c5a4.el8.noarch 5/5 2019-12-19T22:06:32.277 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-grafana-dashboards-2:15.0.0-8663.g368c5a4.el8.n 1/5 2019-12-19T22:06:32.278 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-dashboard-2:15.0.0-8663.g368c5a4.el8.noarch 2/5 2019-12-19T22:06:32.278 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 3/5 2019-12-19T22:06:32.278 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 4/5 2019-12-19T22:06:32.647 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 5/5 2019-12-19T22:06:32.647 INFO:teuthology.orchestra.run.smithi050.stdout:Installed products updated. 2019-12-19T22:06:34.654 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:06:34.654 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2019-12-19T22:06:34.654 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard-2:15.0.0-8663.g368c5a4.el8.noarch 2019-12-19T22:06:34.654 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-grafana-dashboards-2:15.0.0-8663.g368c5a4.el8.noarch 2019-12-19T22:06:34.655 INFO:teuthology.orchestra.run.smithi050.stdout: python3-repoze-lru-0.7-6.el8.noarch 2019-12-19T22:06:34.655 INFO:teuthology.orchestra.run.smithi050.stdout: python3-routes-2.4.1-12.el8.noarch 2019-12-19T22:06:34.655 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jwt-1.6.1-2.el8.noarch 2019-12-19T22:06:34.655 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:06:34.655 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2019-12-19T22:06:34.799 INFO:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-mgr-diskprediction-cloud 2019-12-19T22:06:35.172 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2019-12-19T22:06:35.863 INFO:teuthology.orchestra.run.smithi050.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 59 kB/s | 2.8 kB 00:00 2019-12-19T22:06:35.952 INFO:teuthology.orchestra.run.smithi050.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 40 kB/s | 2.3 kB 00:00 2019-12-19T22:06:36.491 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2019-12-19T22:06:36.491 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:06:36.492 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2019-12-19T22:06:36.492 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:06:36.492 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2019-12-19T22:06:36.492 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-diskprediction-cloud 2019-12-19T22:06:36.492 INFO:teuthology.orchestra.run.smithi050.stdout: noarch 2:15.0.0-8663.g368c5a4.el8 ceph-noarch 41 k 2019-12-19T22:06:36.492 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:06:36.492 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2019-12-19T22:06:36.493 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:06:36.493 INFO:teuthology.orchestra.run.smithi050.stdout:Install 1 Package 2019-12-19T22:06:36.493 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:06:36.493 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 41 k 2019-12-19T22:06:36.494 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 212 k 2019-12-19T22:06:36.494 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2019-12-19T22:06:36.679 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-mgr-diskprediction-cloud-15.0.0-8663.g368c 229 kB/s | 41 kB 00:00 2019-12-19T22:06:36.679 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2019-12-19T22:06:36.679 INFO:teuthology.orchestra.run.smithi050.stdout:Total 228 kB/s | 41 kB 00:00 2019-12-19T22:06:36.679 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2019-12-19T22:06:36.679 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2019-12-19T22:06:36.680 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2019-12-19T22:06:36.705 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2019-12-19T22:06:36.705 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2019-12-19T22:06:36.776 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2019-12-19T22:06:36.951 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-diskprediction-cloud-2:15.0.0-8663.g368c5a4 1/1 2019-12-19T22:06:37.080 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-diskprediction-cloud-2:15.0.0-8663.g368c5a4 1/1 2019-12-19T22:06:37.394 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-diskprediction-cloud-2:15.0.0-8663.g368c5a4 1/1 2019-12-19T22:06:37.394 INFO:teuthology.orchestra.run.smithi050.stdout:Installed products updated. 2019-12-19T22:06:39.206 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:06:39.206 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2019-12-19T22:06:39.206 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-diskprediction-cloud-2:15.0.0-8663.g368c5a4.el8.noarch 2019-12-19T22:06:39.206 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:06:39.207 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2019-12-19T22:06:39.454 INFO:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-mgr-diskprediction-local 2019-12-19T22:06:39.824 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2019-12-19T22:06:40.550 INFO:teuthology.orchestra.run.smithi050.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 64 kB/s | 2.8 kB 00:00 2019-12-19T22:06:40.656 INFO:teuthology.orchestra.run.smithi050.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 32 kB/s | 2.3 kB 00:00 2019-12-19T22:06:41.175 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2019-12-19T22:06:41.176 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:06:41.176 INFO:teuthology.orchestra.run.smithi050.stdout: Package ArchVersion Repository Size 2019-12-19T22:06:41.177 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:06:41.177 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2019-12-19T22:06:41.177 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-diskprediction-local noarch2:15.0.0-8663.g368c5a4.el8 ceph-noarch 8.6 M 2019-12-19T22:06:41.177 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2019-12-19T22:06:41.177 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-f2py x86_641:1.14.3-6.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2019-12-19T22:06:41.177 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-threads x86_640.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 4.4 M 2019-12-19T22:06:41.178 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy x86_641:1.14.3-6.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2019-12-19T22:06:41.178 INFO:teuthology.orchestra.run.smithi050.stdout: openblas x86_640.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 4.3 M 2019-12-19T22:06:41.178 INFO:teuthology.orchestra.run.smithi050.stdout: python3-scipy x86_641.0.0-19.module+el8.0.0+2966+d39a1df3 rhel-8-for-x86_64-appstream-rpms 15 M 2019-12-19T22:06:41.178 INFO:teuthology.orchestra.run.smithi050.stdout: libquadmath x86_648.2.1-3.5.el8 rhel-8-for-x86_64-baseos-rpms 167 k 2019-12-19T22:06:41.178 INFO:teuthology.orchestra.run.smithi050.stdout: libgfortran x86_648.2.1-3.5.el8 rhel-8-for-x86_64-baseos-rpms 636 k 2019-12-19T22:06:41.178 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:06:41.179 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2019-12-19T22:06:41.179 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:06:41.179 INFO:teuthology.orchestra.run.smithi050.stdout:Install 8 Packages 2019-12-19T22:06:41.179 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:06:41.180 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 37 M 2019-12-19T22:06:41.180 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 203 M 2019-12-19T22:06:41.180 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2019-12-19T22:06:41.246 INFO:teuthology.orchestra.run.smithi050.stdout:(1/8): python3-numpy-f2py-1.14.3-6.el8.x86_64.r 3.3 MB/s | 225 kB 00:00 2019-12-19T22:06:41.295 INFO:teuthology.orchestra.run.smithi050.stdout:(2/8): openblas-threads-0.3.3-2.el8.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2019-12-19T22:06:41.326 INFO:teuthology.orchestra.run.smithi050.stdout:(3/8): python3-numpy-1.14.3-6.el8.x86_64.rpm 46 MB/s | 3.7 MB 00:00 2019-12-19T22:06:41.375 INFO:teuthology.orchestra.run.smithi050.stdout:(4/8): openblas-0.3.3-2.el8.x86_64.rpm 54 MB/s | 4.3 MB 00:00 2019-12-19T22:06:41.405 INFO:teuthology.orchestra.run.smithi050.stdout:(5/8): libquadmath-8.2.1-3.5.el8.x86_64.rpm 5.5 MB/s | 167 kB 00:00 2019-12-19T22:06:41.439 INFO:teuthology.orchestra.run.smithi050.stdout:(6/8): libgfortran-8.2.1-3.5.el8.x86_64.rpm 18 MB/s | 636 kB 00:00 2019-12-19T22:06:41.562 INFO:teuthology.orchestra.run.smithi050.stdout:(7/8): python3-scipy-1.0.0-19.module+el8.0.0+29 62 MB/s | 15 MB 00:00 2019-12-19T22:06:41.679 INFO:teuthology.orchestra.run.smithi050.stdout:(8/8): ceph-mgr-diskprediction-local-15.0.0-866 17 MB/s | 8.6 MB 00:00 2019-12-19T22:06:41.680 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2019-12-19T22:06:41.681 INFO:teuthology.orchestra.run.smithi050.stdout:Total 73 MB/s | 37 MB 00:00 2019-12-19T22:06:41.691 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2019-12-19T22:06:41.711 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2019-12-19T22:06:41.711 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2019-12-19T22:06:42.011 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2019-12-19T22:06:42.011 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2019-12-19T22:06:42.537 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2019-12-19T22:06:42.683 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libquadmath-8.2.1-3.5.el8.x86_64 1/8 2019-12-19T22:06:42.809 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libquadmath-8.2.1-3.5.el8.x86_64 1/8 2019-12-19T22:06:42.959 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libgfortran-8.2.1-3.5.el8.x86_64 2/8 2019-12-19T22:06:43.548 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libgfortran-8.2.1-3.5.el8.x86_64 2/8 2019-12-19T22:06:43.692 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openblas-threads-0.3.3-2.el8.x86_64 3/8 2019-12-19T22:06:44.264 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: openblas-threads-0.3.3-2.el8.x86_64 3/8 2019-12-19T22:06:44.458 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openblas-0.3.3-2.el8.x86_64 4/8 2019-12-19T22:06:45.199 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: openblas-0.3.3-2.el8.x86_64 4/8 2019-12-19T22:06:45.519 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-numpy-1:1.14.3-6.el8.x86_64 5/8 2019-12-19T22:06:45.708 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-numpy-f2py-1:1.14.3-6.el8.x86_64 6/8 2019-12-19T22:06:47.777 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-6.el8.x86_64 6/8 2019-12-19T22:06:49.170 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-scipy-1.0.0-19.module+el8.0.0+2966+d39a1df3. 7/8 2019-12-19T22:06:49.324 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-diskprediction-local-2:15.0.0-8663.g368c5a4 8/8 2019-12-19T22:06:49.554 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:15.0.0-8663.g368c5a4 8/8 2019-12-19T22:06:49.554 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-diskprediction-local-2:15.0.0-8663.g368c5a4 1/8 2019-12-19T22:06:49.554 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-numpy-f2py-1:1.14.3-6.el8.x86_64 2/8 2019-12-19T22:06:49.554 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openblas-threads-0.3.3-2.el8.x86_64 3/8 2019-12-19T22:06:49.554 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-numpy-1:1.14.3-6.el8.x86_64 4/8 2019-12-19T22:06:49.554 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openblas-0.3.3-2.el8.x86_64 5/8 2019-12-19T22:06:49.555 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-scipy-1.0.0-19.module+el8.0.0+2966+d39a1df3. 6/8 2019-12-19T22:06:49.555 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libquadmath-8.2.1-3.5.el8.x86_64 7/8 2019-12-19T22:06:49.936 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libgfortran-8.2.1-3.5.el8.x86_64 8/8 2019-12-19T22:06:49.937 INFO:teuthology.orchestra.run.smithi050.stdout:Installed products updated. 2019-12-19T22:06:51.679 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:06:51.679 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2019-12-19T22:06:51.680 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-diskprediction-local-2:15.0.0-8663.g368c5a4.el8.noarch 2019-12-19T22:06:51.680 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-f2py-1:1.14.3-6.el8.x86_64 2019-12-19T22:06:51.680 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-threads-0.3.3-2.el8.x86_64 2019-12-19T22:06:51.680 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-1:1.14.3-6.el8.x86_64 2019-12-19T22:06:51.681 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-0.3.3-2.el8.x86_64 2019-12-19T22:06:51.681 INFO:teuthology.orchestra.run.smithi050.stdout: python3-scipy-1.0.0-19.module+el8.0.0+2966+d39a1df3.x86_64 2019-12-19T22:06:51.681 INFO:teuthology.orchestra.run.smithi050.stdout: libquadmath-8.2.1-3.5.el8.x86_64 2019-12-19T22:06:51.681 INFO:teuthology.orchestra.run.smithi050.stdout: libgfortran-8.2.1-3.5.el8.x86_64 2019-12-19T22:06:51.681 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:06:51.682 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2019-12-19T22:06:51.829 INFO:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-mgr-rook 2019-12-19T22:06:52.201 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2019-12-19T22:06:52.932 INFO:teuthology.orchestra.run.smithi050.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 60 kB/s | 2.8 kB 00:00 2019-12-19T22:06:53.014 INFO:teuthology.orchestra.run.smithi050.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 47 kB/s | 2.3 kB 00:00 2019-12-19T22:06:53.623 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2019-12-19T22:06:53.625 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:06:53.625 INFO:teuthology.orchestra.run.smithi050.stdout: Package ArchVersion Repository Size 2019-12-19T22:06:53.625 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:06:53.625 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2019-12-19T22:06:53.626 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-rook noarch2:15.0.0-8663.g368c5a4.el8 ceph-noarch 16 k 2019-12-19T22:06:53.626 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2019-12-19T22:06:53.626 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cachetools noarch3.1.1-4.el8 epel 33 k 2019-12-19T22:06:53.626 INFO:teuthology.orchestra.run.smithi050.stdout: python3-certifi noarch2018.10.15-7.el8 epel 16 k 2019-12-19T22:06:53.626 INFO:teuthology.orchestra.run.smithi050.stdout: python3-google-auth noarch1:1.1.1-10.el8 epel 81 k 2019-12-19T22:06:53.626 INFO:teuthology.orchestra.run.smithi050.stdout: python3-kubernetes noarch10.0.1-1.el8 epel 1.1 M 2019-12-19T22:06:53.627 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rsa noarch3.4.2-12.el8 epel 73 k 2019-12-19T22:06:53.627 INFO:teuthology.orchestra.run.smithi050.stdout: python3-websocket-client noarch0.56.0-5.el8 epel 61 k 2019-12-19T22:06:53.627 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1 noarch0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2019-12-19T22:06:53.627 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-modules noarch0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2019-12-19T22:06:53.627 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-oauthlib noarch1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2019-12-19T22:06:53.628 INFO:teuthology.orchestra.run.smithi050.stdout: python3-oauthlib noarch2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2019-12-19T22:06:53.628 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:06:53.628 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2019-12-19T22:06:53.628 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:06:53.628 INFO:teuthology.orchestra.run.smithi050.stdout:Install 11 Packages 2019-12-19T22:06:53.628 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:06:53.628 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 1.8 M 2019-12-19T22:06:53.629 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 23 M 2019-12-19T22:06:53.629 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2019-12-19T22:06:54.752 INFO:teuthology.orchestra.run.smithi050.stdout:(1/11): python3-certifi-2018.10.15-7.el8.noarch 163 kB/s | 16 kB 00:00 2019-12-19T22:06:54.753 INFO:teuthology.orchestra.run.smithi050.stdout:(2/11): python3-cachetools-3.1.1-4.el8.noarch.r 329 kB/s | 33 kB 00:00 2019-12-19T22:06:54.785 INFO:teuthology.orchestra.run.smithi050.stdout:(3/11): ceph-mgr-rook-15.0.0-8663.g368c5a4.el8. 123 kB/s | 16 kB 00:00 2019-12-19T22:06:54.818 INFO:teuthology.orchestra.run.smithi050.stdout:(4/11): python3-google-auth-1.1.1-10.el8.noarch 1.2 MB/s | 81 kB 00:00 2019-12-19T22:06:54.883 INFO:teuthology.orchestra.run.smithi050.stdout:(5/11): python3-websocket-client-0.56.0-5.el8.n 959 kB/s | 61 kB 00:00 2019-12-19T22:06:54.918 INFO:teuthology.orchestra.run.smithi050.stdout:(6/11): python3-rsa-3.4.2-12.el8.noarch.rpm 550 kB/s | 73 kB 00:00 2019-12-19T22:06:54.935 INFO:teuthology.orchestra.run.smithi050.stdout:(7/11): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.4 MB/s | 126 kB 00:00 2019-12-19T22:06:54.980 INFO:teuthology.orchestra.run.smithi050.stdout:(8/11): python3-requests-oauthlib-1.0.0-1.el8.n 948 kB/s | 43 kB 00:00 2019-12-19T22:06:54.982 INFO:teuthology.orchestra.run.smithi050.stdout:(9/11): python3-pyasn1-modules-0.3.7-6.el8.noar 1.7 MB/s | 110 kB 00:00 2019-12-19T22:06:55.012 INFO:teuthology.orchestra.run.smithi050.stdout:(10/11): python3-oauthlib-2.1.0-1.el8.noarch.rp 4.7 MB/s | 155 kB 00:00 2019-12-19T22:06:55.055 INFO:teuthology.orchestra.run.smithi050.stdout:(11/11): python3-kubernetes-10.0.1-1.el8.noarch 3.7 MB/s | 1.1 MB 00:00 2019-12-19T22:06:55.055 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2019-12-19T22:06:55.055 INFO:teuthology.orchestra.run.smithi050.stdout:Total 1.3 MB/s | 1.8 MB 00:01 2019-12-19T22:06:55.060 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2019-12-19T22:06:55.075 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2019-12-19T22:06:55.075 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2019-12-19T22:06:55.136 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2019-12-19T22:06:55.136 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2019-12-19T22:06:55.548 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2019-12-19T22:06:55.783 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/11 2019-12-19T22:06:56.006 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rsa-3.4.2-12.el8.noarch 2/11 2019-12-19T22:06:56.251 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 3/11 2019-12-19T22:06:56.438 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 4/11 2019-12-19T22:06:56.611 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 5/11 2019-12-19T22:06:56.798 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 6/11 2019-12-19T22:06:56.973 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 7/11 2019-12-19T22:06:57.199 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 8/11 2019-12-19T22:06:58.302 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 9/11 2019-12-19T22:06:58.551 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-kubernetes-10.0.1-1.el8.noarch 10/11 2019-12-19T22:06:58.698 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-rook-2:15.0.0-8663.g368c5a4.el8.noarch 11/11 2019-12-19T22:06:58.904 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-rook-2:15.0.0-8663.g368c5a4.el8.noarch 11/11 2019-12-19T22:06:58.904 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-rook-2:15.0.0-8663.g368c5a4.el8.noarch 1/11 2019-12-19T22:06:58.904 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 2/11 2019-12-19T22:06:58.904 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 3/11 2019-12-19T22:06:58.904 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 4/11 2019-12-19T22:06:58.904 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-kubernetes-10.0.1-1.el8.noarch 5/11 2019-12-19T22:06:58.905 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rsa-3.4.2-12.el8.noarch 6/11 2019-12-19T22:06:58.905 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 7/11 2019-12-19T22:06:58.905 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 8/11 2019-12-19T22:06:58.905 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 9/11 2019-12-19T22:06:58.905 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 10/11 2019-12-19T22:06:59.330 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 11/11 2019-12-19T22:06:59.330 INFO:teuthology.orchestra.run.smithi050.stdout:Installed products updated. 2019-12-19T22:07:01.227 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:07:01.228 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2019-12-19T22:07:01.228 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-rook-2:15.0.0-8663.g368c5a4.el8.noarch 2019-12-19T22:07:01.228 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cachetools-3.1.1-4.el8.noarch 2019-12-19T22:07:01.228 INFO:teuthology.orchestra.run.smithi050.stdout: python3-certifi-2018.10.15-7.el8.noarch 2019-12-19T22:07:01.228 INFO:teuthology.orchestra.run.smithi050.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2019-12-19T22:07:01.229 INFO:teuthology.orchestra.run.smithi050.stdout: python3-kubernetes-10.0.1-1.el8.noarch 2019-12-19T22:07:01.229 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rsa-3.4.2-12.el8.noarch 2019-12-19T22:07:01.229 INFO:teuthology.orchestra.run.smithi050.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2019-12-19T22:07:01.229 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2019-12-19T22:07:01.229 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2019-12-19T22:07:01.229 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2019-12-19T22:07:01.229 INFO:teuthology.orchestra.run.smithi050.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2019-12-19T22:07:01.230 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:07:01.230 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2019-12-19T22:07:01.402 INFO:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-mgr-cephadm 2019-12-19T22:07:01.789 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2019-12-19T22:07:02.700 INFO:teuthology.orchestra.run.smithi050.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 54 kB/s | 2.8 kB 00:00 2019-12-19T22:07:02.778 INFO:teuthology.orchestra.run.smithi050.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 50 kB/s | 2.3 kB 00:00 2019-12-19T22:07:03.313 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2019-12-19T22:07:03.314 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:07:03.314 INFO:teuthology.orchestra.run.smithi050.stdout: Package ArchVersion Repository Size 2019-12-19T22:07:03.314 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:07:03.314 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2019-12-19T22:07:03.314 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-cephadm noarch2:15.0.0-8663.g368c5a4.el8 ceph-noarch 24 k 2019-12-19T22:07:03.314 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2019-12-19T22:07:03.315 INFO:teuthology.orchestra.run.smithi050.stdout: python3-execnet noarch1.7.1-1.el8.2 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 356 k 2019-12-19T22:07:03.315 INFO:teuthology.orchestra.run.smithi050.stdout: python3-remoto noarch1.1.4-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 48 k 2019-12-19T22:07:03.315 INFO:teuthology.orchestra.run.smithi050.stdout: python3-apipkg noarch1.5-2.el8 epel 21 k 2019-12-19T22:07:03.315 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:07:03.316 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2019-12-19T22:07:03.316 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:07:03.316 INFO:teuthology.orchestra.run.smithi050.stdout:Install 4 Packages 2019-12-19T22:07:03.316 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:07:03.317 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 448 k 2019-12-19T22:07:03.317 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 1.4 M 2019-12-19T22:07:03.317 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2019-12-19T22:07:03.553 INFO:teuthology.orchestra.run.smithi050.stdout:(1/4): ceph-mgr-cephadm-15.0.0-8663.g368c5a4.el 167 kB/s | 24 kB 00:00 2019-12-19T22:07:03.715 INFO:teuthology.orchestra.run.smithi050.stdout:(2/4): python3-apipkg-1.5-2.el8.noarch.rpm 129 kB/s | 21 kB 00:00 2019-12-19T22:07:03.852 INFO:teuthology.orchestra.run.smithi050.stdout:(3/4): python3-remoto-1.1.4-4.el8.noarch.rpm 109 kB/s | 48 kB 00:00 2019-12-19T22:07:03.967 INFO:teuthology.orchestra.run.smithi050.stdout:(4/4): python3-execnet-1.7.1-1.el8.2.noarch.rpm 638 kB/s | 356 kB 00:00 2019-12-19T22:07:03.970 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2019-12-19T22:07:03.971 INFO:teuthology.orchestra.run.smithi050.stdout:Total 683 kB/s | 448 kB 00:00 2019-12-19T22:07:03.974 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2019-12-19T22:07:03.981 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2019-12-19T22:07:03.981 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2019-12-19T22:07:04.008 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2019-12-19T22:07:04.008 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2019-12-19T22:07:04.168 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2019-12-19T22:07:04.434 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-apipkg-1.5-2.el8.noarch 1/4 2019-12-19T22:07:04.663 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-execnet-1.7.1-1.el8.2.noarch 2/4 2019-12-19T22:07:04.910 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 3/4 2019-12-19T22:07:05.030 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-cephadm-2:15.0.0-8663.g368c5a4.el8.noarch 4/4 2019-12-19T22:07:05.220 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-cephadm-2:15.0.0-8663.g368c5a4.el8.noarch 4/4 2019-12-19T22:07:05.220 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-cephadm-2:15.0.0-8663.g368c5a4.el8.noarch 1/4 2019-12-19T22:07:05.220 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-execnet-1.7.1-1.el8.2.noarch 2/4 2019-12-19T22:07:05.220 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 3/4 2019-12-19T22:07:05.584 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-apipkg-1.5-2.el8.noarch 4/4 2019-12-19T22:07:05.584 INFO:teuthology.orchestra.run.smithi050.stdout:Installed products updated. 2019-12-19T22:07:08.605 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:07:08.605 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2019-12-19T22:07:08.605 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-cephadm-2:15.0.0-8663.g368c5a4.el8.noarch 2019-12-19T22:07:08.605 INFO:teuthology.orchestra.run.smithi050.stdout: python3-execnet-1.7.1-1.el8.2.noarch 2019-12-19T22:07:08.605 INFO:teuthology.orchestra.run.smithi050.stdout: python3-remoto-1.1.4-4.el8.noarch 2019-12-19T22:07:08.606 INFO:teuthology.orchestra.run.smithi050.stdout: python3-apipkg-1.5-2.el8.noarch 2019-12-19T22:07:08.606 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:07:08.606 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2019-12-19T22:07:08.757 INFO:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-fuse 2019-12-19T22:07:09.133 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2019-12-19T22:07:10.277 INFO:teuthology.orchestra.run.smithi050.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 62 kB/s | 2.8 kB 00:00 2019-12-19T22:07:10.349 INFO:teuthology.orchestra.run.smithi050.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 57 kB/s | 2.3 kB 00:00 2019-12-19T22:07:10.868 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2019-12-19T22:07:10.869 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:07:10.869 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2019-12-19T22:07:10.869 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:07:10.869 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2019-12-19T22:07:10.869 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-fuse x86_64 2:15.0.0-8663.g368c5a4.el8 2019-12-19T22:07:10.870 INFO:teuthology.orchestra.run.smithi050.stdout: ceph 567 k 2019-12-19T22:07:10.870 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2019-12-19T22:07:10.870 INFO:teuthology.orchestra.run.smithi050.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2019-12-19T22:07:10.870 INFO:teuthology.orchestra.run.smithi050.stdout: fuse-common x86_64 3.2.1-12.el8 rhel-8-for-x86_64-baseos-rpms 21 k 2019-12-19T22:07:10.870 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:07:10.870 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2019-12-19T22:07:10.871 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:07:10.871 INFO:teuthology.orchestra.run.smithi050.stdout:Install 3 Packages 2019-12-19T22:07:10.871 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:07:10.872 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 670 k 2019-12-19T22:07:10.872 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 2.0 M 2019-12-19T22:07:10.872 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2019-12-19T22:07:10.932 INFO:teuthology.orchestra.run.smithi050.stdout:(1/3): fuse-2.9.7-12.el8.x86_64.rpm 1.3 MB/s | 83 kB 00:00 2019-12-19T22:07:10.942 INFO:teuthology.orchestra.run.smithi050.stdout:(2/3): fuse-common-3.2.1-12.el8.x86_64.rpm 297 kB/s | 21 kB 00:00 2019-12-19T22:07:11.065 INFO:teuthology.orchestra.run.smithi050.stdout:(3/3): ceph-fuse-15.0.0-8663.g368c5a4.el8.x86_6 2.8 MB/s | 567 kB 00:00 2019-12-19T22:07:11.066 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2019-12-19T22:07:11.066 INFO:teuthology.orchestra.run.smithi050.stdout:Total 3.3 MB/s | 670 kB 00:00 2019-12-19T22:07:11.068 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2019-12-19T22:07:11.091 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2019-12-19T22:07:11.091 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2019-12-19T22:07:11.155 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2019-12-19T22:07:11.155 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2019-12-19T22:07:11.316 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2019-12-19T22:07:11.430 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 1/3 2019-12-19T22:07:11.430 INFO:teuthology.orchestra.run.smithi050.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2019-12-19T22:07:11.430 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:07:11.639 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : fuse-2.9.7-12.el8.x86_64 2/3 2019-12-19T22:07:11.762 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-fuse-2:15.0.0-8663.g368c5a4.el8.x86_64 3/3 2019-12-19T22:07:12.054 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-fuse-2:15.0.0-8663.g368c5a4.el8.x86_64 3/3 2019-12-19T22:07:12.055 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-fuse-2:15.0.0-8663.g368c5a4.el8.x86_64 1/3 2019-12-19T22:07:12.055 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/3 2019-12-19T22:07:12.481 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 3/3 2019-12-19T22:07:12.481 INFO:teuthology.orchestra.run.smithi050.stdout:Installed products updated. 2019-12-19T22:07:14.635 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:07:14.635 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2019-12-19T22:07:14.636 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-fuse-2:15.0.0-8663.g368c5a4.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2019-12-19T22:07:14.636 INFO:teuthology.orchestra.run.smithi050.stdout: fuse-common-3.2.1-12.el8.x86_64 2019-12-19T22:07:14.636 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:07:14.636 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2019-12-19T22:07:15.366 INFO:teuthology.orchestra.run.smithi050:> sudo yum -y install libcephfs2 2019-12-19T22:07:15.748 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2019-12-19T22:07:16.461 INFO:teuthology.orchestra.run.smithi050.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 67 kB/s | 2.8 kB 00:00 2019-12-19T22:07:16.532 INFO:teuthology.orchestra.run.smithi050.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 60 kB/s | 2.3 kB 00:00 2019-12-19T22:07:16.947 INFO:teuthology.orchestra.run.smithi050.stdout:Package libcephfs2-2:15.0.0-8663.g368c5a4.el8.x86_64 is already installed. 2019-12-19T22:07:17.076 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2019-12-19T22:07:17.076 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2019-12-19T22:07:17.076 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2019-12-19T22:07:17.213 INFO:teuthology.orchestra.run.smithi050:> sudo yum -y install libcephfs-devel 2019-12-19T22:07:17.586 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2019-12-19T22:07:18.376 INFO:teuthology.orchestra.run.smithi050.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 71 kB/s | 2.8 kB 00:00 2019-12-19T22:07:18.452 INFO:teuthology.orchestra.run.smithi050.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 53 kB/s | 2.3 kB 00:00 2019-12-19T22:07:18.977 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2019-12-19T22:07:18.977 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:07:18.978 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository 2019-12-19T22:07:18.978 INFO:teuthology.orchestra.run.smithi050.stdout: Size 2019-12-19T22:07:18.978 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:07:18.978 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2019-12-19T22:07:18.978 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs-devel x86_64 2:15.0.0-8663.g368c5a4.el8 ceph 21 k 2019-12-19T22:07:18.978 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2019-12-19T22:07:18.978 INFO:teuthology.orchestra.run.smithi050.stdout: librados-devel x86_64 2:15.0.0-8663.g368c5a4.el8 ceph 139 k 2019-12-19T22:07:18.979 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:07:18.979 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2019-12-19T22:07:18.979 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:07:18.979 INFO:teuthology.orchestra.run.smithi050.stdout:Install 2 Packages 2019-12-19T22:07:18.979 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:07:18.980 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 160 k 2019-12-19T22:07:18.980 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 605 k 2019-12-19T22:07:18.980 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2019-12-19T22:07:19.294 INFO:teuthology.orchestra.run.smithi050.stdout:(1/2): libcephfs-devel-15.0.0-8663.g368c5a4.el8 67 kB/s | 21 kB 00:00 2019-12-19T22:07:19.432 INFO:teuthology.orchestra.run.smithi050.stdout:(2/2): librados-devel-15.0.0-8663.g368c5a4.el8. 307 kB/s | 139 kB 00:00 2019-12-19T22:07:19.433 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2019-12-19T22:07:19.433 INFO:teuthology.orchestra.run.smithi050.stdout:Total 352 kB/s | 160 kB 00:00 2019-12-19T22:07:19.434 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2019-12-19T22:07:19.441 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2019-12-19T22:07:19.441 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2019-12-19T22:07:19.495 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2019-12-19T22:07:19.496 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2019-12-19T22:07:19.635 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2019-12-19T22:07:19.765 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librados-devel-2:15.0.0-8663.g368c5a4.el8.x86_64 1/2 2019-12-19T22:07:19.944 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephfs-devel-2:15.0.0-8663.g368c5a4.el8.x86_64 2/2 2019-12-19T22:07:20.144 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libcephfs-devel-2:15.0.0-8663.g368c5a4.el8.x86_64 2/2 2019-12-19T22:07:20.144 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephfs-devel-2:15.0.0-8663.g368c5a4.el8.x86_64 1/2 2019-12-19T22:07:20.543 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados-devel-2:15.0.0-8663.g368c5a4.el8.x86_64 2/2 2019-12-19T22:07:20.544 INFO:teuthology.orchestra.run.smithi050.stdout:Installed products updated. 2019-12-19T22:07:22.653 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:07:22.653 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2019-12-19T22:07:22.653 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs-devel-2:15.0.0-8663.g368c5a4.el8.x86_64 2019-12-19T22:07:22.653 INFO:teuthology.orchestra.run.smithi050.stdout: librados-devel-2:15.0.0-8663.g368c5a4.el8.x86_64 2019-12-19T22:07:22.653 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:07:22.654 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2019-12-19T22:07:22.813 INFO:teuthology.orchestra.run.smithi050:> sudo yum -y install librados2 2019-12-19T22:07:23.191 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2019-12-19T22:07:23.893 INFO:teuthology.orchestra.run.smithi050.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 67 kB/s | 2.8 kB 00:00 2019-12-19T22:07:23.966 INFO:teuthology.orchestra.run.smithi050.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 53 kB/s | 2.3 kB 00:00 2019-12-19T22:07:24.397 INFO:teuthology.orchestra.run.smithi050.stdout:Package librados2-2:15.0.0-8663.g368c5a4.el8.x86_64 is already installed. 2019-12-19T22:07:24.517 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2019-12-19T22:07:24.518 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2019-12-19T22:07:24.519 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2019-12-19T22:07:24.675 INFO:teuthology.orchestra.run.smithi050:> sudo yum -y install librbd1 2019-12-19T22:07:25.047 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2019-12-19T22:07:25.984 INFO:teuthology.orchestra.run.smithi050.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 64 kB/s | 2.8 kB 00:00 2019-12-19T22:07:26.075 INFO:teuthology.orchestra.run.smithi050.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 38 kB/s | 2.3 kB 00:00 2019-12-19T22:07:26.479 INFO:teuthology.orchestra.run.smithi050.stdout:Package librbd1-2:15.0.0-8663.g368c5a4.el8.x86_64 is already installed. 2019-12-19T22:07:26.601 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2019-12-19T22:07:26.601 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2019-12-19T22:07:26.602 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2019-12-19T22:07:26.734 INFO:teuthology.orchestra.run.smithi050:> sudo yum -y install python3-rados 2019-12-19T22:07:27.108 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2019-12-19T22:07:27.956 INFO:teuthology.orchestra.run.smithi050.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 71 kB/s | 2.8 kB 00:00 2019-12-19T22:07:28.387 INFO:teuthology.orchestra.run.smithi050.stdout:Package python3-rados-2:15.0.0-8663.g368c5a4.el8.x86_64 is already installed. 2019-12-19T22:07:28.511 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2019-12-19T22:07:28.513 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2019-12-19T22:07:28.513 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2019-12-19T22:07:28.651 INFO:teuthology.orchestra.run.smithi050:> sudo yum -y install python3-rgw 2019-12-19T22:07:29.025 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2019-12-19T22:07:30.036 INFO:teuthology.orchestra.run.smithi050.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 61 kB/s | 2.8 kB 00:00 2019-12-19T22:07:30.108 INFO:teuthology.orchestra.run.smithi050.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 46 kB/s | 2.3 kB 00:00 2019-12-19T22:07:30.528 INFO:teuthology.orchestra.run.smithi050.stdout:Package python3-rgw-2:15.0.0-8663.g368c5a4.el8.x86_64 is already installed. 2019-12-19T22:07:30.652 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2019-12-19T22:07:30.653 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2019-12-19T22:07:30.653 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2019-12-19T22:07:30.803 INFO:teuthology.orchestra.run.smithi050:> sudo yum -y install python3-cephfs 2019-12-19T22:07:31.179 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2019-12-19T22:07:32.044 INFO:teuthology.orchestra.run.smithi050.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 59 kB/s | 2.3 kB 00:00 2019-12-19T22:07:32.462 INFO:teuthology.orchestra.run.smithi050.stdout:Package python3-cephfs-2:15.0.0-8663.g368c5a4.el8.x86_64 is already installed. 2019-12-19T22:07:32.584 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2019-12-19T22:07:32.585 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2019-12-19T22:07:32.586 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2019-12-19T22:07:32.858 INFO:teuthology.orchestra.run.smithi050:> sudo yum -y install python3-rbd 2019-12-19T22:07:33.230 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2019-12-19T22:07:33.863 INFO:teuthology.orchestra.run.smithi050.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 67 kB/s | 2.8 kB 00:00 2019-12-19T22:07:34.394 INFO:teuthology.orchestra.run.smithi050.stdout:Package python3-rbd-2:15.0.0-8663.g368c5a4.el8.x86_64 is already installed. 2019-12-19T22:07:34.516 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2019-12-19T22:07:34.518 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2019-12-19T22:07:34.518 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2019-12-19T22:07:34.742 INFO:teuthology.orchestra.run.smithi050:> sudo yum -y install rbd-fuse 2019-12-19T22:07:35.125 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2019-12-19T22:07:35.942 INFO:teuthology.orchestra.run.smithi050.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 68 kB/s | 2.8 kB 00:00 2019-12-19T22:07:36.002 INFO:teuthology.orchestra.run.smithi050.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 59 kB/s | 2.3 kB 00:00 2019-12-19T22:07:36.574 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2019-12-19T22:07:36.575 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:07:36.575 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2019-12-19T22:07:36.575 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:07:36.575 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2019-12-19T22:07:36.575 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-fuse x86_64 2:15.0.0-8663.g368c5a4.el8 ceph 72 k 2019-12-19T22:07:36.576 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:07:36.576 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2019-12-19T22:07:36.576 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:07:36.576 INFO:teuthology.orchestra.run.smithi050.stdout:Install 1 Package 2019-12-19T22:07:36.576 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:07:36.576 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 72 k 2019-12-19T22:07:36.576 INFO:teuthology.orchestra.run.smithi050.stdout:Installed size: 214 k 2019-12-19T22:07:36.577 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2019-12-19T22:07:36.707 INFO:teuthology.orchestra.run.smithi050.stdout:rbd-fuse-15.0.0-8663.g368c5a4.el8.x86_64.rpm 548 kB/s | 72 kB 00:00 2019-12-19T22:07:36.708 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2019-12-19T22:07:36.708 INFO:teuthology.orchestra.run.smithi050.stdout:Total 543 kB/s | 72 kB 00:00 2019-12-19T22:07:36.709 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2019-12-19T22:07:36.720 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2019-12-19T22:07:36.720 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2019-12-19T22:07:36.771 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2019-12-19T22:07:36.771 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2019-12-19T22:07:36.875 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2019-12-19T22:07:37.050 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-fuse-2:15.0.0-8663.g368c5a4.el8.x86_64 1/1 2019-12-19T22:07:37.254 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: rbd-fuse-2:15.0.0-8663.g368c5a4.el8.x86_64 1/1 2019-12-19T22:07:37.638 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-fuse-2:15.0.0-8663.g368c5a4.el8.x86_64 1/1 2019-12-19T22:07:37.639 INFO:teuthology.orchestra.run.smithi050.stdout:Installed products updated. 2019-12-19T22:07:40.232 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:07:40.233 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2019-12-19T22:07:40.233 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-fuse-2:15.0.0-8663.g368c5a4.el8.x86_64 2019-12-19T22:07:40.233 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:07:40.233 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2019-12-19T22:07:40.387 DEBUG:teuthology.parallel:result is None 2019-12-19T22:07:40.387 INFO:teuthology.orchestra.run.smithi050:> sudo lsb_release -is 2019-12-19T22:07:40.429 INFO:teuthology.orchestra.run.smithi050.stdout:RedHatEnterprise 2019-12-19T22:07:40.430 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2019-12-19T22:07:40.432 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=368c5a40f375d6b61b7b988b7a7f4598540a0665 2019-12-19T22:07:40.604 INFO:teuthology.orchestra.run.smithi050:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2019-12-19T22:07:40.624 INFO:teuthology.orchestra.run.smithi050.stdout:15.0.0-8663.g368c5a4.el8 2019-12-19T22:07:40.624 INFO:teuthology.packaging:The installed version of ceph is 15.0.0-8663.g368c5a4.el8 2019-12-19T22:07:40.624 INFO:teuthology.task.install:The correct ceph version 15.0.0-8663.g368c5a4 is installed. 2019-12-19T22:07:40.625 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2019-12-19T22:07:40.625 INFO:teuthology.orchestra.run.smithi050:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2019-12-19T22:07:40.697 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2019-12-19T22:07:40.698 INFO:teuthology.orchestra.run.smithi050:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2019-12-19T22:07:40.770 INFO:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/daemon-helper 2019-12-19T22:07:40.841 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2019-12-19T22:07:40.842 INFO:teuthology.orchestra.run.smithi050:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2019-12-19T22:07:40.929 INFO:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2019-12-19T22:07:41.000 INFO:teuthology.run_tasks:Running task ceph... 2019-12-19T22:07:41.074 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2019-12-19T22:07:41.074 INFO:teuthology.orchestra.run.smithi050:> sudo chmod 777 /var/log/ceph 2019-12-19T22:07:41.105 INFO:tasks.ceph:Disabling ceph logrotate... 2019-12-19T22:07:41.105 INFO:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/logrotate.d/ceph 2019-12-19T22:07:41.176 INFO:tasks.ceph:Creating extra log directories... 2019-12-19T22:07:41.197 INFO:teuthology.orchestra.run.smithi050:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2019-12-19T22:07:41.247 INFO:tasks.ceph:Creating ceph cluster ceph... 2019-12-19T22:07:41.248 INFO:tasks.ceph:config {'mon_bind_addrvec': True, 'block_journal': None, 'fs': 'xfs', 'log_whitelist': ['overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'skip_mgr_daemons': False, 'cpu_profile': set([]), 'mkfs_options': None, 'tmpfs_journal': None, 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mount_options': None, 'conf': {'global': {'osd max object namespace len': 64, 'debug ms': 1, 'osd max object name len': 460, 'debug client': 20, 'debug mds': 20}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'debug ms': 1}, 'osd': {'osd op queue cut off': 'debug_random', 'debug ms': 1, 'debug journal': 20, 'debug osd': 25, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd op queue': 'debug_random', 'debug filestore': 20}}} 2019-12-19T22:07:41.248 INFO:tasks.ceph:ctx.config {'kernel': {'sha1': 'distro', 'kdb': True}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (1, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'sha1': 'distro', 'kdb': True}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'cluster': 'ceph', 'log-whitelist': ['overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'conf': {'global': {'osd max object namespace len': 64, 'debug ms': 1, 'osd max object name len': 460, 'debug client': 20, 'debug mds': 20}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'debug ms': 1}, 'osd': {'osd op queue cut off': 'debug_random', 'debug ms': 1, 'debug journal': 20, 'debug osd': 25, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd op queue': 'debug_random', 'debug filestore': 20}}, 'sha1': '368c5a40f375d6b61b7b988b7a7f4598540a0665'}}, {'exec': {'client.0': ['ceph osd pool create data_cache 4', 'ceph osd tier add cephfs_data data_cache', 'ceph osd tier cache-mode data_cache writeback', 'ceph osd tier set-overlay cephfs_data data_cache', 'ceph osd pool set data_cache hit_set_type bloom', 'ceph osd pool set data_cache hit_set_count 8', 'ceph osd pool set data_cache hit_set_period 3600', 'ceph osd pool set data_cache min_read_recency_for_promote 0']}}, {'ceph-fuse': None}, {'exec': {'client.0': ['sudo chmod 777 $TESTDIR/mnt.0/', 'dd if=/dev/urandom of=$TESTDIR/mnt.0/foo bs=1M count=5', 'ls -al $TESTDIR/mnt.0/foo', 'truncate --size 0 $TESTDIR/mnt.0/foo', 'ls -al $TESTDIR/mnt.0/foo', 'dd if=/dev/urandom of=$TESTDIR/mnt.0/foo bs=1M count=5', 'ls -al $TESTDIR/mnt.0/foo', 'cp $TESTDIR/mnt.0/foo /tmp/foo', 'sync', 'rados -p data_cache ls -', 'sleep 10', 'rados -p data_cache ls -', 'rados -p data_cache cache-flush-evict-all', 'rados -p data_cache ls -', 'sleep 1']}}, {'exec': {'client.1': ['hexdump -C /tmp/foo | head', 'hexdump -C $TESTDIR/mnt.1/foo | head', 'cmp $TESTDIR/mnt.1/foo /tmp/foo']}}], 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_wip-sjust-read-from-replica/qa', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.22728', 'owner': 'scheduled_sjust@teuthology', 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'targets': {'smithi050.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHoLc37hEFjrkHVo88aK6CoYNX3fXCnBBSTlYnd0/SItFCzGdnyPXF6N5APIs9IZCyNZT+1dyR6YXYd/FAAlkAUZlPsKhC+ZPhyNDXqOhrk6/5mDRWcB0nvXMtrt/uo0FRbSN2hEX9uRCsdyZMo/iAsQpaaCqrgCbIlI0xJxiQYRrsv/hG8uM0Rt9OHkpM2TRMeAFI9BH8LDSepadqCn7omc5lHdr/Xa7lhYn1tF1JblsajjpF7S/CdWNhM9VsblZq1eQ/GG25qP2SJtSMzVwa2cjRsTWcHjxEb+dkUIEqzD7I5mql98sBhMb18W1IBncAuMMZFZ4lRPGEnAFSXQ/j'}, 'job_id': '4615662', 'tube': 'smithi', 'suite_branch': 'wip-sjust-read-from-replica', 'priority': 91, 'os_version': '8.0', 'first_in_suite': False, 'branch': 'wip-sjust-read-from-replica', 'suite': 'rados', 'email': None, 'archive_path': '/home/teuthworker/archive/sjust-2019-12-19_20:06:11-rados-wip-sjust-read-from-replica-distro-basic-smithi/4615662', 'description': 'rados/singleton-nomsgr/{all/cache-fs-trunc.yaml rados.yaml supported-random-distro$/{rhel_8.yaml}}', 'nuke-on-error': True, 'repo': 'https://github.com/ceph/ceph-ci.git', 'last_in_suite': False, 'machine_type': 'smithi', 'teuthology_branch': 'master', 'sha1': '368c5a40f375d6b61b7b988b7a7f4598540a0665', 'name': 'sjust-2019-12-19_20:06:11-rados-wip-sjust-read-from-replica-distro-basic-smithi', 'roles': [['mon.a', 'mgr.x', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'client.0', 'client.1']], 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '368c5a40f375d6b61b7b988b7a7f4598540a0665', 'os_type': 'rhel', 'overrides': {'ceph': {'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'conf': {'mon': {'debug mon': 20, 'debug paxos': 20, 'debug ms': 1}, 'osd': {'osd op queue cut off': 'debug_random', 'debug ms': 1, 'debug journal': 20, 'debug osd': 25, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd op queue': 'debug_random', 'debug filestore': 20}}, 'sha1': '368c5a40f375d6b61b7b988b7a7f4598540a0665'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'workunit': {'sha1': '368c5a40f375d6b61b7b988b7a7f4598540a0665', 'branch': 'wip-sjust-read-from-replica'}, 'install': {'ceph': {'sha1': '368c5a40f375d6b61b7b988b7a7f4598540a0665'}}, 'admin_socket': {'branch': 'wip-sjust-read-from-replica'}}} 2019-12-19T22:07:41.248 INFO:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2019-12-19T22:07:41.302 INFO:teuthology.orchestra.run.smithi050:> sudo install -d -m0777 -- /var/run/ceph 2019-12-19T22:07:41.430 DEBUG:teuthology.orchestra.remote:smithi050:/scratch_devs is 72B 2019-12-19T22:07:41.479 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-12-19T22:07:41.479 INFO:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2019-12-19T22:07:41.493 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-1 2019-12-19T22:07:41.494 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-19T22:07:41.494 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 6h/6d Inode: 94810 Links: 1 2019-12-19T22:07:41.494 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-19T22:07:41.494 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2019-12-19T22:07:41.494 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2019-12-19 22:07:11.883341100 +0000 2019-12-19T22:07:41.494 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2019-12-19 22:04:46.412271899 +0000 2019-12-19T22:07:41.495 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2019-12-19 22:04:46.412271899 +0000 2019-12-19T22:07:41.495 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2019-12-19T22:07:41.510 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2019-12-19T22:07:41.510 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2019-12-19T22:07:41.510 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 9.8667e-05 s, 5.2 MB/s 2019-12-19T22:07:41.513 INFO:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2019-12-19T22:07:41.568 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2019-12-19T22:07:41.568 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-19T22:07:41.568 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 6h/6d Inode: 92736 Links: 1 2019-12-19T22:07:41.569 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-19T22:07:41.569 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2019-12-19T22:07:41.569 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2019-12-19 22:07:11.883341100 +0000 2019-12-19T22:07:41.569 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2019-12-19 22:04:46.782262392 +0000 2019-12-19T22:07:41.569 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2019-12-19 22:04:46.782262392 +0000 2019-12-19T22:07:41.569 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2019-12-19T22:07:41.585 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2019-12-19T22:07:41.585 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2019-12-19T22:07:41.586 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 7.9427e-05 s, 6.4 MB/s 2019-12-19T22:07:41.587 INFO:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2019-12-19T22:07:41.642 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-3 2019-12-19T22:07:41.642 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-19T22:07:41.642 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 6h/6d Inode: 92771 Links: 1 2019-12-19T22:07:41.642 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-19T22:07:41.643 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2019-12-19T22:07:41.643 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2019-12-19 22:07:11.883341100 +0000 2019-12-19T22:07:41.643 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2019-12-19 22:04:47.162252628 +0000 2019-12-19T22:07:41.643 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2019-12-19 22:04:47.162252628 +0000 2019-12-19T22:07:41.643 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2019-12-19T22:07:41.658 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2019-12-19T22:07:41.658 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2019-12-19T22:07:41.658 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 8.0079e-05 s, 6.4 MB/s 2019-12-19T22:07:41.661 INFO:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2019-12-19T22:07:41.727 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-4 2019-12-19T22:07:41.727 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-19T22:07:41.728 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 6h/6d Inode: 95481 Links: 1 2019-12-19T22:07:41.728 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-19T22:07:41.728 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2019-12-19T22:07:41.728 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2019-12-19 22:07:11.883341100 +0000 2019-12-19T22:07:41.729 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2019-12-19 22:04:47.528243224 +0000 2019-12-19T22:07:41.729 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2019-12-19 22:04:47.528243224 +0000 2019-12-19T22:07:41.729 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2019-12-19T22:07:41.731 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2019-12-19T22:07:41.732 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2019-12-19T22:07:41.732 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 9.5795e-05 s, 5.3 MB/s 2019-12-19T22:07:41.734 INFO:tasks.ceph:fs option selected, checking for scratch devs 2019-12-19T22:07:41.734 INFO:tasks.ceph:found devs: ['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-12-19T22:07:41.734 WARNING:teuthology.misc:Entering get_wwn_id_map, a deprecated function that will be removed 2019-12-19T22:07:41.735 INFO:tasks.ceph:dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-12-19T22:07:41.735 INFO:tasks.ceph:Generating config... 2019-12-19T22:07:41.736 INFO:tasks.ceph:[global] osd max object namespace len = 64 2019-12-19T22:07:41.736 INFO:tasks.ceph:[global] debug ms = 1 2019-12-19T22:07:41.737 INFO:tasks.ceph:[global] osd max object name len = 460 2019-12-19T22:07:41.737 INFO:tasks.ceph:[global] debug client = 20 2019-12-19T22:07:41.737 INFO:tasks.ceph:[global] debug mds = 20 2019-12-19T22:07:41.737 INFO:tasks.ceph:[mon] debug mon = 20 2019-12-19T22:07:41.737 INFO:tasks.ceph:[mon] debug paxos = 20 2019-12-19T22:07:41.737 INFO:tasks.ceph:[mon] debug ms = 1 2019-12-19T22:07:41.737 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2019-12-19T22:07:41.739 INFO:tasks.ceph:[osd] debug ms = 1 2019-12-19T22:07:41.739 INFO:tasks.ceph:[osd] debug journal = 20 2019-12-19T22:07:41.739 INFO:tasks.ceph:[osd] debug osd = 25 2019-12-19T22:07:41.739 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2019-12-19T22:07:41.740 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2019-12-19T22:07:41.740 INFO:tasks.ceph:[osd] osd op queue = debug_random 2019-12-19T22:07:41.740 INFO:tasks.ceph:[osd] debug filestore = 20 2019-12-19T22:07:41.740 INFO:tasks.ceph:Setting up mon.a... 2019-12-19T22:07:41.740 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2019-12-19T22:07:41.820 INFO:teuthology.orchestra.run.smithi050.stdout:creating /etc/ceph/ceph.keyring 2019-12-19T22:07:41.822 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2019-12-19T22:07:41.873 INFO:teuthology.orchestra.run.smithi050:> sudo chmod 0644 /etc/ceph/ceph.keyring 2019-12-19T22:07:41.949 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.50')] 2019-12-19T22:07:41.949 INFO:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.15.50 --print /home/ubuntu/cephtest/ceph.monmap 2019-12-19T22:07:42.023 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2019-12-19T22:07:42.024 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool: generated fsid c1382993-41cc-4b35-a402-c17778701f01 2019-12-19T22:07:42.024 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 0 2019-12-19T22:07:42.024 INFO:teuthology.orchestra.run.smithi050.stdout:fsid c1382993-41cc-4b35-a402-c17778701f01 2019-12-19T22:07:42.024 INFO:teuthology.orchestra.run.smithi050.stdout:last_changed 2019-12-19T22:07:42.020700+0000 2019-12-19T22:07:42.024 INFO:teuthology.orchestra.run.smithi050.stdout:created 2019-12-19T22:07:42.020700+0000 2019-12-19T22:07:42.024 INFO:teuthology.orchestra.run.smithi050.stdout:min_mon_release 0 (unknown) 2019-12-19T22:07:42.025 INFO:teuthology.orchestra.run.smithi050.stdout:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2019-12-19T22:07:42.025 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2019-12-19T22:07:42.025 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c1382993-41cc-4b35-a402-c17778701f01... 2019-12-19T22:07:42.026 INFO:teuthology.orchestra.run.smithi050:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2019-12-19T22:07:42.128 INFO:teuthology.orchestra.run.smithi050.stdout:[global] 2019-12-19T22:07:42.128 INFO:teuthology.orchestra.run.smithi050.stdout: chdir = "" 2019-12-19T22:07:42.128 INFO:teuthology.orchestra.run.smithi050.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2019-12-19T22:07:42.129 INFO:teuthology.orchestra.run.smithi050.stdout: auth supported = cephx 2019-12-19T22:07:42.129 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:07:42.129 INFO:teuthology.orchestra.run.smithi050.stdout: filestore xattr use omap = true 2019-12-19T22:07:42.129 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:07:42.129 INFO:teuthology.orchestra.run.smithi050.stdout: mon clock drift allowed = 1.000 2019-12-19T22:07:42.129 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:07:42.129 INFO:teuthology.orchestra.run.smithi050.stdout: osd crush chooseleaf type = 0 2019-12-19T22:07:42.130 INFO:teuthology.orchestra.run.smithi050.stdout: auth debug = true 2019-12-19T22:07:42.130 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:07:42.130 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on old message = true 2019-12-19T22:07:42.130 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on bug = true 2019-12-19T22:07:42.130 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:07:42.130 INFO:teuthology.orchestra.run.smithi050.stdout: mon max pg per osd = 10000 # >= luminous 2019-12-19T22:07:42.130 INFO:teuthology.orchestra.run.smithi050.stdout: mon pg warn max object skew = 0 2019-12-19T22:07:42.130 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:07:42.131 INFO:teuthology.orchestra.run.smithi050.stdout: # disable pg_autoscaler by default for new pools 2019-12-19T22:07:42.131 INFO:teuthology.orchestra.run.smithi050.stdout: osd_pool_default_pg_autoscale_mode = off 2019-12-19T22:07:42.131 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:07:42.131 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default size = 2 2019-12-19T22:07:42.131 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:07:42.131 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow primary affinity = true 2019-12-19T22:07:42.131 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow pg remap = true 2019-12-19T22:07:42.132 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on legacy crush tunables = false 2019-12-19T22:07:42.132 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on crush straw calc version zero = false 2019-12-19T22:07:42.132 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on no sortbitwise = false 2019-12-19T22:07:42.132 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on osd down out interval zero = false 2019-12-19T22:07:42.132 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on too few osds = false 2019-12-19T22:07:42.132 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2019-12-19T22:07:42.132 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_no_redundancy = false 2019-12-19T22:07:42.133 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:07:42.133 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2019-12-19T22:07:42.133 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:07:42.133 INFO:teuthology.orchestra.run.smithi050.stdout: osd default data pool replay window = 5 2019-12-19T22:07:42.133 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:07:42.133 INFO:teuthology.orchestra.run.smithi050.stdout: mon allow pool delete = true 2019-12-19T22:07:42.133 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:07:42.134 INFO:teuthology.orchestra.run.smithi050.stdout: mon cluster log file level = debug 2019-12-19T22:07:42.134 INFO:teuthology.orchestra.run.smithi050.stdout: debug asserts on shutdown = true 2019-12-19T22:07:42.134 INFO:teuthology.orchestra.run.smithi050.stdout: mon host = 172.21.15.50 2019-12-19T22:07:42.134 INFO:teuthology.orchestra.run.smithi050.stdout: osd max object namespace len = 64 2019-12-19T22:07:42.134 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2019-12-19T22:07:42.134 INFO:teuthology.orchestra.run.smithi050.stdout: osd max object name len = 460 2019-12-19T22:07:42.135 INFO:teuthology.orchestra.run.smithi050.stdout: debug client = 20 2019-12-19T22:07:42.135 INFO:teuthology.orchestra.run.smithi050.stdout: debug mds = 20 2019-12-19T22:07:42.135 INFO:teuthology.orchestra.run.smithi050.stdout: fsid = c1382993-41cc-4b35-a402-c17778701f01 2019-12-19T22:07:42.135 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:07:42.135 INFO:teuthology.orchestra.run.smithi050.stdout:[osd] 2019-12-19T22:07:42.135 INFO:teuthology.orchestra.run.smithi050.stdout: osd journal size = 100 2019-12-19T22:07:42.135 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:07:42.135 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub load threshold = 5.0 2019-12-19T22:07:42.136 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub max interval = 600 2019-12-19T22:07:42.136 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:07:42.136 INFO:teuthology.orchestra.run.smithi050.stdout: osd recover clone overlap = true 2019-12-19T22:07:42.136 INFO:teuthology.orchestra.run.smithi050.stdout: osd recovery max chunk = 1048576 2019-12-19T22:07:42.136 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:07:42.136 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug shutdown = true 2019-12-19T22:07:42.136 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug op order = true 2019-12-19T22:07:42.137 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug verify stray on activate = true 2019-12-19T22:07:42.137 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:07:42.137 INFO:teuthology.orchestra.run.smithi050.stdout: osd open classes on start = true 2019-12-19T22:07:42.137 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug pg log writeout = true 2019-12-19T22:07:42.137 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:07:42.137 INFO:teuthology.orchestra.run.smithi050.stdout: osd deep scrub update digest min age = 30 2019-12-19T22:07:42.137 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:07:42.138 INFO:teuthology.orchestra.run.smithi050.stdout: osd map max advance = 10 2019-12-19T22:07:42.138 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:07:42.138 INFO:teuthology.orchestra.run.smithi050.stdout: journal zero on create = true 2019-12-19T22:07:42.138 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:07:42.138 INFO:teuthology.orchestra.run.smithi050.stdout: filestore ondisk finisher threads = 3 2019-12-19T22:07:42.138 INFO:teuthology.orchestra.run.smithi050.stdout: filestore apply finisher threads = 3 2019-12-19T22:07:42.138 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:07:42.139 INFO:teuthology.orchestra.run.smithi050.stdout: bdev debug aio = true 2019-12-19T22:07:42.139 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug misdirected ops = true 2019-12-19T22:07:42.139 INFO:teuthology.orchestra.run.smithi050.stdout: osd op queue cut off = debug_random 2019-12-19T22:07:42.139 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2019-12-19T22:07:42.139 INFO:teuthology.orchestra.run.smithi050.stdout: debug journal = 20 2019-12-19T22:07:42.139 INFO:teuthology.orchestra.run.smithi050.stdout: debug osd = 25 2019-12-19T22:07:42.140 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug verify cached snaps = True 2019-12-19T22:07:42.140 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug verify missing on start = True 2019-12-19T22:07:42.140 INFO:teuthology.orchestra.run.smithi050.stdout: osd op queue = debug_random 2019-12-19T22:07:42.140 INFO:teuthology.orchestra.run.smithi050.stdout: debug filestore = 20 2019-12-19T22:07:42.140 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:07:42.140 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr] 2019-12-19T22:07:42.140 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2019-12-19T22:07:42.141 INFO:teuthology.orchestra.run.smithi050.stdout: debug mgr = 20 2019-12-19T22:07:42.141 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2019-12-19T22:07:42.141 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2019-12-19T22:07:42.141 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2019-12-19T22:07:42.141 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2019-12-19T22:07:42.141 INFO:teuthology.orchestra.run.smithi050.stdout: mgr/telemetry/nag = false 2019-12-19T22:07:42.141 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:07:42.142 INFO:teuthology.orchestra.run.smithi050.stdout:[mon] 2019-12-19T22:07:42.142 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2019-12-19T22:07:42.142 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2019-12-19T22:07:42.142 INFO:teuthology.orchestra.run.smithi050.stdout: debug paxos = 20 2019-12-19T22:07:42.142 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2019-12-19T22:07:42.142 INFO:teuthology.orchestra.run.smithi050.stdout: mon data avail warn = 5 2019-12-19T22:07:42.142 INFO:teuthology.orchestra.run.smithi050.stdout: mon mgr mkfs grace = 240 2019-12-19T22:07:42.142 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2019-12-19T22:07:42.143 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd reporter subtree level = osd 2019-12-19T22:07:42.143 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd prime pg temp = true 2019-12-19T22:07:42.143 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2019-12-19T22:07:42.143 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:07:42.143 INFO:teuthology.orchestra.run.smithi050.stdout:[client] 2019-12-19T22:07:42.143 INFO:teuthology.orchestra.run.smithi050.stdout: rgw cache enabled = true 2019-12-19T22:07:42.143 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable ops log = true 2019-12-19T22:07:42.144 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable usage log = true 2019-12-19T22:07:42.144 INFO:teuthology.orchestra.run.smithi050.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2019-12-19T22:07:42.144 INFO:teuthology.orchestra.run.smithi050.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2019-12-19T22:07:42.144 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.a] 2019-12-19T22:07:42.144 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.a] 2019-12-19T22:07:42.148 INFO:tasks.ceph:Creating admin key on mon.a... 2019-12-19T22:07:42.148 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2019-12-19T22:07:42.203 INFO:tasks.ceph:Copying monmap to all nodes... 2019-12-19T22:07:42.227 DEBUG:teuthology.orchestra.remote:smithi050:/etc/ceph/ceph.keyring is 206B 2019-12-19T22:07:42.338 DEBUG:teuthology.orchestra.remote:smithi050:/home/ubuntu/cephtest/ceph.monmap is 179B 2019-12-19T22:07:42.387 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi050.front.sepia.ceph.com 2019-12-19T22:07:42.387 INFO:teuthology.orchestra.run.smithi050:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2019-12-19T22:07:42.449 INFO:teuthology.orchestra.run.smithi050:> cat > /home/ubuntu/cephtest/ceph.monmap 2019-12-19T22:07:42.535 INFO:tasks.ceph:Setting up mon nodes... 2019-12-19T22:07:42.535 INFO:tasks.ceph:Setting up mgr nodes... 2019-12-19T22:07:42.535 INFO:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2019-12-19T22:07:42.636 INFO:teuthology.orchestra.run.smithi050.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2019-12-19T22:07:42.638 INFO:tasks.ceph:Setting up mds nodes... 2019-12-19T22:07:42.638 INFO:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2019-12-19T22:07:42.698 INFO:teuthology.orchestra.run.smithi050.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2019-12-19T22:07:42.700 INFO:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2019-12-19T22:07:42.732 INFO:tasks.ceph_client:Setting up client nodes... 2019-12-19T22:07:42.732 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2019-12-19T22:07:42.816 INFO:teuthology.orchestra.run.smithi050.stdout:creating /etc/ceph/ceph.client.0.keyring 2019-12-19T22:07:42.835 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2019-12-19T22:07:42.919 INFO:teuthology.orchestra.run.smithi050.stdout:creating /etc/ceph/ceph.client.1.keyring 2019-12-19T22:07:42.937 INFO:tasks.ceph:Running mkfs on osd nodes... 2019-12-19T22:07:42.938 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi050.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.2': '/dev/vg_nvme/lv_2'}} 2019-12-19T22:07:42.938 INFO:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2019-12-19T22:07:43.012 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-12-19T22:07:43.012 INFO:tasks.ceph:{} 2019-12-19T22:07:43.012 INFO:tasks.ceph:osd.0 2019-12-19T22:07:43.012 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi050.front.sepia.ceph.com 2019-12-19T22:07:43.013 INFO:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2019-12-19T22:07:43.107 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2019-12-19T22:07:43.108 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-19T22:07:43.108 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2019-12-19T22:07:43.108 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 2019-12-19T22:07:43.108 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-19T22:07:43.108 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2019-12-19T22:07:43.108 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2019-12-19T22:07:43.109 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-19T22:07:43.109 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-19T22:07:43.109 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-19T22:07:43.113 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2019-12-19T22:07:43.113 INFO:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0 2019-12-19T22:07:43.159 INFO:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2019-12-19T22:07:43.197 INFO:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2019-12-19T22:07:43.268 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-12-19T22:07:43.269 INFO:tasks.ceph:{} 2019-12-19T22:07:43.269 INFO:tasks.ceph:osd.1 2019-12-19T22:07:43.269 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi050.front.sepia.ceph.com 2019-12-19T22:07:43.269 INFO:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2019-12-19T22:07:43.364 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2019-12-19T22:07:43.364 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-19T22:07:43.364 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2019-12-19T22:07:43.365 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 2019-12-19T22:07:43.365 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-19T22:07:43.365 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2019-12-19T22:07:43.365 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2019-12-19T22:07:43.365 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-19T22:07:43.365 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-19T22:07:43.365 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-19T22:07:43.366 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2019-12-19T22:07:43.366 INFO:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2019-12-19T22:07:43.410 INFO:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2019-12-19T22:07:43.488 INFO:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2019-12-19T22:07:43.558 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-12-19T22:07:43.559 INFO:tasks.ceph:{} 2019-12-19T22:07:43.559 INFO:tasks.ceph:osd.2 2019-12-19T22:07:43.559 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi050.front.sepia.ceph.com 2019-12-19T22:07:43.559 INFO:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2019-12-19T22:07:43.654 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2019-12-19T22:07:43.654 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-19T22:07:43.655 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2019-12-19T22:07:43.655 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 2019-12-19T22:07:43.655 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-19T22:07:43.655 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2019-12-19T22:07:43.655 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2019-12-19T22:07:43.655 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-19T22:07:43.656 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-19T22:07:43.656 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-19T22:07:43.657 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2019-12-19T22:07:43.657 INFO:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2019-12-19T22:07:43.699 INFO:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2019-12-19T22:07:43.773 INFO:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-12-19T22:07:43.865 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:43.861+0000 7fcfde506ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2019-12-19T22:07:43.865 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:43.861+0000 7fcfde506ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2019-12-19T22:07:43.870 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:43.861+0000 7fcfde506ec0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2019-12-19T22:07:43.870 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:43.861+0000 7fcfde506ec0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2019-12-19T22:07:43.870 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:43.861+0000 7fcfde506ec0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2019-12-19T22:07:43.871 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:43.862+0000 7fcfde506ec0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2019-12-19T22:07:45.688 INFO:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2019-12-19T22:07:45.724 INFO:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-12-19T22:07:45.816 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:45.813+0000 7f8b21db7ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2019-12-19T22:07:45.817 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:45.813+0000 7f8b21db7ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2019-12-19T22:07:45.817 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:45.813+0000 7f8b21db7ec0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2019-12-19T22:07:45.817 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:45.813+0000 7f8b21db7ec0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2019-12-19T22:07:45.817 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:45.813+0000 7f8b21db7ec0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2019-12-19T22:07:45.817 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:45.814+0000 7f8b21db7ec0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2019-12-19T22:07:47.645 INFO:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2019-12-19T22:07:47.681 INFO:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-12-19T22:07:47.773 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:47.771+0000 7fb4c9e23ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2019-12-19T22:07:47.774 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:47.771+0000 7fb4c9e23ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2019-12-19T22:07:47.774 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:47.771+0000 7fb4c9e23ec0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2019-12-19T22:07:47.774 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:47.771+0000 7fb4c9e23ec0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2019-12-19T22:07:47.774 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:47.771+0000 7fb4c9e23ec0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2019-12-19T22:07:47.774 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:47.771+0000 7fb4c9e23ec0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2019-12-19T22:07:49.595 INFO:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2019-12-19T22:07:49.634 INFO:tasks.ceph:Reading keys from all nodes... 2019-12-19T22:07:49.634 INFO:teuthology.orchestra.run.smithi050:> mktemp 2019-12-19T22:07:49.690 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.XRczm6cE9h 2019-12-19T22:07:49.691 INFO:teuthology.orchestra.run.smithi050:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.XRczm6cE9h 2019-12-19T22:07:49.772 INFO:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.XRczm6cE9h 2019-12-19T22:07:49.915 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.XRczm6cE9h is 56B 2019-12-19T22:07:49.968 INFO:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.XRczm6cE9h 2019-12-19T22:07:49.985 INFO:teuthology.orchestra.run.smithi050:> mktemp 2019-12-19T22:07:50.040 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.4YDGzPAFmi 2019-12-19T22:07:50.041 INFO:teuthology.orchestra.run.smithi050:> sudo cp /var/lib/ceph/mds/ceph-a/keyring /tmp/tmp.4YDGzPAFmi 2019-12-19T22:07:50.113 INFO:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.4YDGzPAFmi 2019-12-19T22:07:50.250 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.4YDGzPAFmi is 56B 2019-12-19T22:07:50.307 INFO:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.4YDGzPAFmi 2019-12-19T22:07:50.322 INFO:teuthology.orchestra.run.smithi050:> mktemp 2019-12-19T22:07:50.385 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.606CgIzPYU 2019-12-19T22:07:50.386 INFO:teuthology.orchestra.run.smithi050:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.606CgIzPYU 2019-12-19T22:07:50.450 INFO:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.606CgIzPYU 2019-12-19T22:07:50.581 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.606CgIzPYU is 56B 2019-12-19T22:07:50.645 INFO:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.606CgIzPYU 2019-12-19T22:07:50.660 INFO:teuthology.orchestra.run.smithi050:> mktemp 2019-12-19T22:07:50.714 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.iTpEcJBm8U 2019-12-19T22:07:50.714 INFO:teuthology.orchestra.run.smithi050:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.iTpEcJBm8U 2019-12-19T22:07:50.786 INFO:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.iTpEcJBm8U 2019-12-19T22:07:50.914 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.iTpEcJBm8U is 56B 2019-12-19T22:07:50.964 INFO:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.iTpEcJBm8U 2019-12-19T22:07:50.979 INFO:teuthology.orchestra.run.smithi050:> mktemp 2019-12-19T22:07:51.031 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.N88wDd8J5T 2019-12-19T22:07:51.032 INFO:teuthology.orchestra.run.smithi050:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.N88wDd8J5T 2019-12-19T22:07:51.103 INFO:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.N88wDd8J5T 2019-12-19T22:07:51.235 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.N88wDd8J5T is 56B 2019-12-19T22:07:51.287 INFO:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.N88wDd8J5T 2019-12-19T22:07:51.358 DEBUG:teuthology.orchestra.remote:smithi050:/etc/ceph/ceph.client.0.keyring is 59B 2019-12-19T22:07:51.452 DEBUG:teuthology.orchestra.remote:smithi050:/etc/ceph/ceph.client.1.keyring is 59B 2019-12-19T22:07:51.501 INFO:tasks.ceph:Adding keys to all mons... 2019-12-19T22:07:51.502 INFO:teuthology.orchestra.run.smithi050:> sudo tee -a /etc/ceph/ceph.keyring 2019-12-19T22:07:51.546 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr.x] 2019-12-19T22:07:51.547 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCu9PtdZbHbJRAAaqioB+nEuWvk88M1UdoMwQ== 2019-12-19T22:07:51.547 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.a] 2019-12-19T22:07:51.547 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCu9PtdGLaWKRAANTrwqBj70DNZI5DTpjyBkA== 2019-12-19T22:07:51.547 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.0] 2019-12-19T22:07:51.547 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCv9PtdisRvMxAAaxS5StPBT5MehnVEuPgkFA== 2019-12-19T22:07:51.548 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.1] 2019-12-19T22:07:51.548 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCx9Ptd6wGTMBAAL/SJsV4O4nLjqY0r026CKQ== 2019-12-19T22:07:51.549 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.2] 2019-12-19T22:07:51.549 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCz9PtdarMILhAAENwVdpw8c7NIfgWTj38LgQ== 2019-12-19T22:07:51.549 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2019-12-19T22:07:51.549 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCu9Ptdn06WMBAAiEZFYmlO24nYSK3zDhieyA== 2019-12-19T22:07:51.549 INFO:teuthology.orchestra.run.smithi050.stdout:[client.1] 2019-12-19T22:07:51.549 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCu9Ptdkg24NhAAgRve55b1kkPQ95ofp6tt7g== 2019-12-19T22:07:51.551 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-12-19T22:07:51.643 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2019-12-19T22:07:51.700 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-19T22:07:51.756 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-19T22:07:51.810 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-19T22:07:51.863 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-12-19T22:07:51.918 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-12-19T22:07:51.973 INFO:tasks.ceph:Running mkfs on mon nodes... 2019-12-19T22:07:51.973 INFO:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2019-12-19T22:07:52.004 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2019-12-19T22:07:52.109 INFO:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2019-12-19T22:07:52.142 INFO:teuthology.orchestra.run.smithi050:> rm -- /home/ubuntu/cephtest/ceph.monmap 2019-12-19T22:07:52.201 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2019-12-19T22:07:52.203 INFO:tasks.ceph.mon.a:Restarting daemon 2019-12-19T22:07:52.203 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2019-12-19T22:07:52.239 INFO:tasks.ceph.mon.a:Started 2019-12-19T22:07:52.240 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2019-12-19T22:07:52.240 INFO:tasks.ceph.mgr.x:Restarting daemon 2019-12-19T22:07:52.240 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2019-12-19T22:07:52.242 INFO:tasks.ceph.mgr.x:Started 2019-12-19T22:07:52.242 INFO:tasks.ceph:Setting crush tunables to default 2019-12-19T22:07:52.243 INFO:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd crush tunables default 2019-12-19T22:07:52.370 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.362+0000 7f0cbf59e700 1 Processor -- start 2019-12-19T22:07:52.370 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.362+0000 7f0cbf59e700 1 -- start start 2019-12-19T22:07:52.371 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.363+0000 7f0cbf59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0cc0063880 0x7f0cc0080370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:07:52.371 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.363+0000 7f0cbf59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc00641e0 con 0x7f0cc0063cb0 2019-12-19T22:07:52.371 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.363+0000 7f0cbf59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cc008aed0 con 0x7f0cc0063880 2019-12-19T22:07:52.372 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.363+0000 7f0cbed9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0cc0063880 0x7f0cc0080370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:07:52.372 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.363+0000 7f0cbed9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0cc0063880 0x7f0cc0080370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53300/0 (socket says 172.21.15.50:53300) 2019-12-19T22:07:52.372 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.363+0000 7f0cbed9d700 1 -- 172.21.15.50:0/728495099 learned_addr learned my addr 172.21.15.50:0/728495099 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:07:52.372 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.363+0000 7f0cbe59c700 1 --1- 172.21.15.50:0/728495099 >> v1:172.21.15.50:6789/0 conn(0x7f0cc0063cb0 0x7f0cc0089190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39428/0 (socket says 172.21.15.50:39428) 2019-12-19T22:07:52.372 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.363+0000 7f0cbed9d700 1 -- 172.21.15.50:0/728495099 >> v1:172.21.15.50:6789/0 conn(0x7f0cc0063cb0 legacy=0x7f0cc0089190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:07:52.372 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.363+0000 7f0cbed9d700 1 -- 172.21.15.50:0/728495099 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc0063260 con 0x7f0cc0063880 2019-12-19T22:07:52.372 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.363+0000 7f0cbed9d700 1 --2- 172.21.15.50:0/728495099 >> v2:172.21.15.50:3300/0 conn(0x7f0cc0063880 0x7f0cc0080370 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0cb0002f30 tx=0x7f0cb000fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:52.373 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.363+0000 7f0cbed9d700 1 --2- 172.21.15.50:0/728495099 >> v2:172.21.15.50:3300/0 conn(0x7f0cc0063880 0x7f0cc0080370 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0cb0002f30 tx=0x7f0cb000fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:52.373 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.363+0000 7f0cbed9d700 1 --2- 172.21.15.50:0/728495099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cc0063880 0x7f0cc0080370 secure :-1 s=READY pgs=2 cs=0 l=1 rx=0x7f0cb0002f30 tx=0x7f0cb000fcb0).ready entity=mon.0 client_cookie=f06a861a016dda42 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:07:52.373 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.363+0000 7f0cbed9d700 1 --2- 172.21.15.50:0/728495099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cc0063880 0x7f0cc0080370 secure :-1 s=THROTTLE_DONE pgs=2 cs=0 l=1 rx=0x7f0cb0002f30 tx=0x7f0cb000fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:52.373 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.363+0000 7f0cbdd9b700 1 -- 172.21.15.50:0/728495099 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f0cb00112f0 con 0x7f0cc0063880 2019-12-19T22:07:52.373 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.363+0000 7f0cbed9d700 1 --2- 172.21.15.50:0/728495099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cc0063880 0x7f0cc0080370 secure :-1 s=THROTTLE_DONE pgs=2 cs=0 l=1 rx=0x7f0cb0002f30 tx=0x7f0cb000fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:52.373 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.363+0000 7f0cbdd9b700 1 -- 172.21.15.50:0/728495099 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb00114f0 con 0x7f0cc0063880 2019-12-19T22:07:52.374 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.363+0000 7f0cbed9d700 1 --2- 172.21.15.50:0/728495099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cc0063880 0x7f0cc0080370 secure :-1 s=THROTTLE_DONE pgs=2 cs=0 l=1 rx=0x7f0cb0002f30 tx=0x7f0cb000fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:52.374 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.363+0000 7f0cbdd9b700 1 -- 172.21.15.50:0/728495099 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f0cb0011810 con 0x7f0cc0063880 2019-12-19T22:07:52.374 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.363+0000 7f0cbf59e700 1 -- 172.21.15.50:0/728495099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cc0063880 msgr2=0x7f0cc0080370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:07:52.374 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.363+0000 7f0cbf59e700 1 --2- 172.21.15.50:0/728495099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cc0063880 0x7f0cc0080370 secure :-1 s=READY pgs=2 cs=0 l=1 rx=0x7f0cb0002f30 tx=0x7f0cb000fcb0).stop 2019-12-19T22:07:52.374 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.364+0000 7f0cbf59e700 1 -- 172.21.15.50:0/728495099 shutdown_connections 2019-12-19T22:07:52.374 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.364+0000 7f0cbf59e700 1 --2- 172.21.15.50:0/728495099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cc0063880 0x7f0cc0080370 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:07:52.375 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.364+0000 7f0cbf59e700 1 -- 172.21.15.50:0/728495099 shutdown_connections 2019-12-19T22:07:52.375 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.364+0000 7f0cbf59e700 1 -- 172.21.15.50:0/728495099 wait complete. 2019-12-19T22:07:52.375 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.364+0000 7f0cbf59e700 1 -- 172.21.15.50:0/728495099 >> 172.21.15.50:0/728495099 conn(0x7f0cc0096230 msgr2=0x7f0cc0024670 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:07:52.375 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.365+0000 7f0cbf59e700 1 Processor -- start 2019-12-19T22:07:52.375 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.365+0000 7f0cbf59e700 1 -- start start 2019-12-19T22:07:52.375 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.365+0000 7f0cbf59e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0cc0093e90 0x7f0cc0126bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:07:52.375 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.365+0000 7f0cbf59e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc0089c40 con 0x7f0cc0080f00 2019-12-19T22:07:52.376 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.365+0000 7f0cbf59e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cc0092f20 con 0x7f0cc0093e90 2019-12-19T22:07:52.376 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.365+0000 7f0cbed9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0cc0080f00 0x7f0cc0093690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39432/0 (socket says 172.21.15.50:39432) 2019-12-19T22:07:52.376 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.365+0000 7f0cbed9d700 1 -- 172.21.15.50:0/471095679 learned_addr learned my addr 172.21.15.50:0/471095679 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:07:52.376 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.365+0000 7f0cbe59c700 1 --2- 172.21.15.50:0/471095679 >> v2:172.21.15.50:3300/0 conn(0x7f0cc0093e90 0x7f0cc0126bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:07:52.376 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.366+0000 7f0caf7fe700 1 -- 172.21.15.50:0/471095679 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1487775960 0 0) 0x7f0cc0089c40 con 0x7f0cc0080f00 2019-12-19T22:07:52.376 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.366+0000 7f0caf7fe700 1 -- 172.21.15.50:0/471095679 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ca40030b0 con 0x7f0cc0080f00 2019-12-19T22:07:52.376 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.366+0000 7f0cbe59c700 1 -- 172.21.15.50:0/471095679 >> v1:172.21.15.50:6789/0 conn(0x7f0cc0080f00 legacy=0x7f0cc0093690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:07:52.377 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.366+0000 7f0cbe59c700 1 -- 172.21.15.50:0/471095679 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc0089960 con 0x7f0cc0093e90 2019-12-19T22:07:52.377 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.366+0000 7f0cbe59c700 1 --2- 172.21.15.50:0/471095679 >> v2:172.21.15.50:3300/0 conn(0x7f0cc0093e90 0x7f0cc0126bb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0cb4000b80 tx=0x7f0cb40107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:52.377 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.366+0000 7f0cbe59c700 1 --2- 172.21.15.50:0/471095679 >> v2:172.21.15.50:3300/0 conn(0x7f0cc0093e90 0x7f0cc0126bb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0cb4000b80 tx=0x7f0cb40107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:52.377 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.366+0000 7f0cbe59c700 1 --2- 172.21.15.50:0/471095679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cc0093e90 0x7f0cc0126bb0 secure :-1 s=READY pgs=4 cs=0 l=1 rx=0x7f0cb4000b80 tx=0x7f0cb40107b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:07:52.377 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.366+0000 7f0cbe59c700 1 --2- 172.21.15.50:0/471095679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cc0093e90 0x7f0cc0126bb0 secure :-1 s=THROTTLE_DONE pgs=4 cs=0 l=1 rx=0x7f0cb4000b80 tx=0x7f0cb40107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:52.377 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.366+0000 7f0caf7fe700 1 -- 172.21.15.50:0/471095679 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f0cb40066d0 con 0x7f0cc0093e90 2019-12-19T22:07:52.377 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.366+0000 7f0cbe59c700 1 --2- 172.21.15.50:0/471095679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cc0093e90 0x7f0cc0126bb0 secure :-1 s=THROTTLE_DONE pgs=4 cs=0 l=1 rx=0x7f0cb4000b80 tx=0x7f0cb40107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:52.378 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.366+0000 7f0cbe59c700 1 --2- 172.21.15.50:0/471095679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cc0093e90 0x7f0cc0126bb0 secure :-1 s=THROTTLE_DONE pgs=4 cs=0 l=1 rx=0x7f0cb4000b80 tx=0x7f0cb40107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:52.378 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.366+0000 7f0caf7fe700 1 -- 172.21.15.50:0/471095679 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb40068d0 con 0x7f0cc0093e90 2019-12-19T22:07:52.378 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.366+0000 7f0cbf59e700 1 -- 172.21.15.50:0/471095679 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cc008c5f0 con 0x7f0cc0093e90 2019-12-19T22:07:52.378 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.366+0000 7f0caf7fe700 1 -- 172.21.15.50:0/471095679 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f0cb4006c30 con 0x7f0cc0093e90 2019-12-19T22:07:52.378 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.366+0000 7f0cbf59e700 1 -- 172.21.15.50:0/471095679 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc0092990 con 0x7f0cc0093e90 2019-12-19T22:07:52.379 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.366+0000 7f0cbe59c700 1 --2- 172.21.15.50:0/471095679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cc0093e90 0x7f0cc0126bb0 secure :-1 s=THROTTLE_DONE pgs=4 cs=0 l=1 rx=0x7f0cb4000b80 tx=0x7f0cb40107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:52.379 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.366+0000 7f0caf7fe700 1 -- 172.21.15.50:0/471095679 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 349+0+0 (secure 0 0 0) 0x7f0cb40113c0 con 0x7f0cc0093e90 2019-12-19T22:07:52.379 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.366+0000 7f0cbe59c700 1 --2- 172.21.15.50:0/471095679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cc0093e90 0x7f0cc0126bb0 secure :-1 s=THROTTLE_DONE pgs=4 cs=0 l=1 rx=0x7f0cb4000b80 tx=0x7f0cb40107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:52.379 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.366+0000 7f0caf7fe700 1 -- 172.21.15.50:0/471095679 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f0cb400b920 con 0x7f0cc0093e90 2019-12-19T22:07:52.379 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.367+0000 7f0cbf59e700 1 -- 172.21.15.50:0/471095679 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cc0056340 con 0x7f0cc0093e90 2019-12-19T22:07:52.380 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.369+0000 7f0cbe59c700 1 --2- 172.21.15.50:0/471095679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cc0093e90 0x7f0cc0126bb0 secure :-1 s=THROTTLE_DONE pgs=4 cs=0 l=1 rx=0x7f0cb4000b80 tx=0x7f0cb40107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:52.380 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.369+0000 7f0caf7fe700 1 -- 172.21.15.50:0/471095679 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+66539 (secure 0 0 0) 0x7f0cc0089960 con 0x7f0cc0093e90 2019-12-19T22:07:52.452 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.450+0000 7f0cbf59e700 1 -- 172.21.15.50:0/471095679 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f0cc0094480 con 0x7f0cc0093e90 2019-12-19T22:07:52.453 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.451+0000 7f0cbe59c700 1 --2- 172.21.15.50:0/471095679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cc0093e90 0x7f0cc0126bb0 secure :-1 s=THROTTLE_DONE pgs=4 cs=0 l=1 rx=0x7f0cb4000b80 tx=0x7f0cb40107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:52.454 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.451+0000 7f0caf7fe700 1 -- 172.21.15.50:0/471095679 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f0cb400bb60 con 0x7f0cc0093e90 2019-12-19T22:07:52.455 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.452+0000 7f0cbf59e700 1 -- 172.21.15.50:0/471095679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cc0093e90 msgr2=0x7f0cc0126bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:07:52.455 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.452+0000 7f0cbf59e700 1 --2- 172.21.15.50:0/471095679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cc0093e90 0x7f0cc0126bb0 secure :-1 s=READY pgs=4 cs=0 l=1 rx=0x7f0cb4000b80 tx=0x7f0cb40107b0).stop 2019-12-19T22:07:52.455 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.452+0000 7f0cbf59e700 1 -- 172.21.15.50:0/471095679 shutdown_connections 2019-12-19T22:07:52.455 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.452+0000 7f0cbf59e700 1 --2- 172.21.15.50:0/471095679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0cc0093e90 0x7f0cc0126bb0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:07:52.456 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.452+0000 7f0cbf59e700 1 -- 172.21.15.50:0/471095679 shutdown_connections 2019-12-19T22:07:52.456 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.452+0000 7f0cbf59e700 1 -- 172.21.15.50:0/471095679 wait complete. 2019-12-19T22:07:52.456 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:52.452+0000 7f0cbf59e700 1 -- 172.21.15.50:0/471095679 >> 172.21.15.50:0/471095679 conn(0x7f0cc0096230 msgr2=0x7f0cc00644f0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:07:52.456 INFO:teuthology.orchestra.run.smithi050.stderr:adjusted tunables profile to default 2019-12-19T22:07:52.464 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2019-12-19T22:07:52.465 INFO:teuthology.orchestra.run.smithi050:> mktemp 2019-12-19T22:07:52.479 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.K4f9rlktjZ 2019-12-19T22:07:52.480 INFO:teuthology.orchestra.run.smithi050:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.K4f9rlktjZ 2019-12-19T22:07:52.553 INFO:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.K4f9rlktjZ 2019-12-19T22:07:52.686 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.K4f9rlktjZ is 37B 2019-12-19T22:07:52.753 INFO:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.K4f9rlktjZ 2019-12-19T22:07:52.773 INFO:teuthology.orchestra.run.smithi050:> mktemp 2019-12-19T22:07:52.823 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.iPX3HzXvj9 2019-12-19T22:07:52.823 INFO:teuthology.orchestra.run.smithi050:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.iPX3HzXvj9 2019-12-19T22:07:52.910 INFO:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.iPX3HzXvj9 2019-12-19T22:07:53.038 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.iPX3HzXvj9 is 37B 2019-12-19T22:07:53.098 INFO:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.iPX3HzXvj9 2019-12-19T22:07:53.113 INFO:teuthology.orchestra.run.smithi050:> mktemp 2019-12-19T22:07:53.175 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.575qETkjwB 2019-12-19T22:07:53.175 INFO:teuthology.orchestra.run.smithi050:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.575qETkjwB 2019-12-19T22:07:53.249 INFO:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.575qETkjwB 2019-12-19T22:07:53.379 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.575qETkjwB is 37B 2019-12-19T22:07:53.428 INFO:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.575qETkjwB 2019-12-19T22:07:53.448 INFO:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd new 6137ed8c-8e2c-4e88-8634-dc763bed14c8 0 2019-12-19T22:07:53.602 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.598+0000 7f979d275700 1 Processor -- start 2019-12-19T22:07:53.602 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.598+0000 7f979d275700 1 -- start start 2019-12-19T22:07:53.602 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.598+0000 7f979d275700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f979807d9b0 0x7f979808f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:07:53.602 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.598+0000 7f979d275700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f979808e2f0 con 0x7f979807dfd0 2019-12-19T22:07:53.602 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.598+0000 7f979d275700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f979808aed0 con 0x7f979807d9b0 2019-12-19T22:07:53.603 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.598+0000 7f97977fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f979807d9b0 0x7f979808f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:07:53.603 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.598+0000 7f97977fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f979807d9b0 0x7f979808f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53316/0 (socket says 172.21.15.50:53316) 2019-12-19T22:07:53.603 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.598+0000 7f97977fe700 1 -- 172.21.15.50:0/2081126825 learned_addr learned my addr 172.21.15.50:0/2081126825 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:07:53.603 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.598+0000 7f978effd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f979807dfd0 0x7f9798089380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39446/0 (socket says 172.21.15.50:39446) 2019-12-19T22:07:53.603 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.599+0000 7f97977fe700 1 -- 172.21.15.50:0/2081126825 >> v1:172.21.15.50:6789/0 conn(0x7f979807dfd0 legacy=0x7f9798089380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:07:53.603 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.599+0000 7f97977fe700 1 -- 172.21.15.50:0/2081126825 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f979808ebf0 con 0x7f979807d9b0 2019-12-19T22:07:53.603 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.599+0000 7f97977fe700 1 --2- 172.21.15.50:0/2081126825 >> v2:172.21.15.50:3300/0 conn(0x7f979807d9b0 0x7f979808f730 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f97880032b0 tx=0x7f9788010030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:53.604 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.599+0000 7f97977fe700 1 --2- 172.21.15.50:0/2081126825 >> v2:172.21.15.50:3300/0 conn(0x7f979807d9b0 0x7f979808f730 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f97880032b0 tx=0x7f9788010030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:53.604 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.599+0000 7f97977fe700 1 --2- 172.21.15.50:0/2081126825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f979807d9b0 0x7f979808f730 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7f97880032b0 tx=0x7f9788010030).ready entity=mon.0 client_cookie=2326b53077e8d8e0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:07:53.604 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.599+0000 7f97977fe700 1 --2- 172.21.15.50:0/2081126825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f979807d9b0 0x7f979808f730 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f97880032b0 tx=0x7f9788010030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:53.604 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.599+0000 7f97977fe700 1 --2- 172.21.15.50:0/2081126825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f979807d9b0 0x7f979808f730 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f97880032b0 tx=0x7f9788010030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:53.604 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.599+0000 7f9796ffd700 1 -- 172.21.15.50:0/2081126825 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f9788011cc0 con 0x7f979807d9b0 2019-12-19T22:07:53.604 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.599+0000 7f97977fe700 1 --2- 172.21.15.50:0/2081126825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f979807d9b0 0x7f979808f730 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f97880032b0 tx=0x7f9788010030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:53.604 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.599+0000 7f9796ffd700 1 -- 172.21.15.50:0/2081126825 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f978800a160 con 0x7f979807d9b0 2019-12-19T22:07:53.605 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.599+0000 7f9796ffd700 1 -- 172.21.15.50:0/2081126825 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f978800a4c0 con 0x7f979807d9b0 2019-12-19T22:07:53.605 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.599+0000 7f979d275700 1 -- 172.21.15.50:0/2081126825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f979807d9b0 msgr2=0x7f979808f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:07:53.605 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.599+0000 7f979d275700 1 --2- 172.21.15.50:0/2081126825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f979807d9b0 0x7f979808f730 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7f97880032b0 tx=0x7f9788010030).stop 2019-12-19T22:07:53.605 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.599+0000 7f979d275700 1 -- 172.21.15.50:0/2081126825 shutdown_connections 2019-12-19T22:07:53.605 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.599+0000 7f979d275700 1 --2- 172.21.15.50:0/2081126825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f979807d9b0 0x7f979808f730 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:07:53.605 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.599+0000 7f979d275700 1 -- 172.21.15.50:0/2081126825 shutdown_connections 2019-12-19T22:07:53.605 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.599+0000 7f979d275700 1 -- 172.21.15.50:0/2081126825 wait complete. 2019-12-19T22:07:53.606 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.600+0000 7f979d275700 1 -- 172.21.15.50:0/2081126825 >> 172.21.15.50:0/2081126825 conn(0x7f97980924c0 msgr2=0x7f9798094900 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:07:53.606 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.600+0000 7f979d275700 1 Processor -- start 2019-12-19T22:07:53.606 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.601+0000 7f979d275700 1 -- start start 2019-12-19T22:07:53.608 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.601+0000 7f979d275700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f979808bab0 0x7f979808bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:07:53.609 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.601+0000 7f979d275700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9798082d90 con 0x7f979808c430 2019-12-19T22:07:53.609 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.601+0000 7f979d275700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9798082100 con 0x7f979808bab0 2019-12-19T22:07:53.609 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.601+0000 7f97977fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f979808bab0 0x7f979808bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:07:53.609 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.601+0000 7f97977fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f979808bab0 0x7f979808bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53320/0 (socket says 172.21.15.50:53320) 2019-12-19T22:07:53.609 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.601+0000 7f97977fe700 1 -- 172.21.15.50:0/3386148590 learned_addr learned my addr 172.21.15.50:0/3386148590 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:07:53.609 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.601+0000 7f97977fe700 1 -- 172.21.15.50:0/3386148590 >> v1:172.21.15.50:6789/0 conn(0x7f979808c430 legacy=0x7f979807a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:07:53.609 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.601+0000 7f97977fe700 1 -- 172.21.15.50:0/3386148590 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f979808c860 con 0x7f979808bab0 2019-12-19T22:07:53.610 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.601+0000 7f97977fe700 1 --2- 172.21.15.50:0/3386148590 >> v2:172.21.15.50:3300/0 conn(0x7f979808bab0 0x7f979808bee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f97880032b0 tx=0x7f978800aa00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:53.610 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.602+0000 7f97977fe700 1 --2- 172.21.15.50:0/3386148590 >> v2:172.21.15.50:3300/0 conn(0x7f979808bab0 0x7f979808bee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f97880032b0 tx=0x7f978800aa00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:53.610 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.602+0000 7f97977fe700 1 --2- 172.21.15.50:0/3386148590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f979808bab0 0x7f979808bee0 secure :-1 s=READY pgs=12 cs=0 l=1 rx=0x7f97880032b0 tx=0x7f978800aa00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:07:53.610 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.602+0000 7f97977fe700 1 --2- 172.21.15.50:0/3386148590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f979808bab0 0x7f979808bee0 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f97880032b0 tx=0x7f978800aa00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:53.610 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.602+0000 7f97977fe700 1 --2- 172.21.15.50:0/3386148590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f979808bab0 0x7f979808bee0 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f97880032b0 tx=0x7f978800aa00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:53.610 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.602+0000 7f9794ff9700 1 -- 172.21.15.50:0/3386148590 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f97880058c0 con 0x7f979808bab0 2019-12-19T22:07:53.610 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.602+0000 7f97977fe700 1 --2- 172.21.15.50:0/3386148590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f979808bab0 0x7f979808bee0 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f97880032b0 tx=0x7f978800aa00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:53.611 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.602+0000 7f9794ff9700 1 -- 172.21.15.50:0/3386148590 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9788005ac0 con 0x7f979808bab0 2019-12-19T22:07:53.611 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.602+0000 7f979d275700 1 -- 172.21.15.50:0/3386148590 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f979805f610 con 0x7f979808bab0 2019-12-19T22:07:53.611 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.602+0000 7f9794ff9700 1 -- 172.21.15.50:0/3386148590 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f9788007150 con 0x7f979808bab0 2019-12-19T22:07:53.611 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.602+0000 7f979d275700 1 -- 172.21.15.50:0/3386148590 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97980828e0 con 0x7f979808bab0 2019-12-19T22:07:53.611 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.602+0000 7f97977fe700 1 --2- 172.21.15.50:0/3386148590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f979808bab0 0x7f979808bee0 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f97880032b0 tx=0x7f978800aa00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:53.611 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.602+0000 7f97977fe700 1 --2- 172.21.15.50:0/3386148590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f979808bab0 0x7f979808bee0 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f97880032b0 tx=0x7f978800aa00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:53.611 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.602+0000 7f9794ff9700 1 -- 172.21.15.50:0/3386148590 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 349+0+0 (secure 0 0 0) 0x7f9788007630 con 0x7f979808bab0 2019-12-19T22:07:53.612 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.602+0000 7f9794ff9700 1 -- 172.21.15.50:0/3386148590 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7f978800c310 con 0x7f979808bab0 2019-12-19T22:07:53.612 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.603+0000 7f979d275700 1 -- 172.21.15.50:0/3386148590 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9798088cb0 con 0x7f979808bab0 2019-12-19T22:07:53.612 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.605+0000 7f97977fe700 1 --2- 172.21.15.50:0/3386148590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f979808bab0 0x7f979808bee0 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f97880032b0 tx=0x7f978800aa00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:53.613 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.605+0000 7f9794ff9700 1 -- 172.21.15.50:0/3386148590 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+66539 (secure 0 0 0) 0x7f978800c5a0 con 0x7f979808bab0 2019-12-19T22:07:53.698 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.697+0000 7f979d275700 1 -- 172.21.15.50:0/3386148590 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6137ed8c-8e2c-4e88-8634-dc763bed14c8", "id": 0} v 0) v1 -- 0x7f9798056340 con 0x7f979808bab0 2019-12-19T22:07:53.700 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.698+0000 7f97977fe700 1 --2- 172.21.15.50:0/3386148590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f979808bab0 0x7f979808bee0 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f97880032b0 tx=0x7f978800aa00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:53.700 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.699+0000 7f9794ff9700 1 -- 172.21.15.50:0/3386148590 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6137ed8c-8e2c-4e88-8634-dc763bed14c8", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f978800c840 con 0x7f979808bab0 2019-12-19T22:07:53.700 INFO:teuthology.orchestra.run.smithi050.stdout:0 2019-12-19T22:07:53.701 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.699+0000 7f979d275700 1 -- 172.21.15.50:0/3386148590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f979808bab0 msgr2=0x7f979808bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:07:53.701 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.699+0000 7f979d275700 1 --2- 172.21.15.50:0/3386148590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f979808bab0 0x7f979808bee0 secure :-1 s=READY pgs=12 cs=0 l=1 rx=0x7f97880032b0 tx=0x7f978800aa00).stop 2019-12-19T22:07:53.701 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.700+0000 7f979d275700 1 -- 172.21.15.50:0/3386148590 shutdown_connections 2019-12-19T22:07:53.702 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.700+0000 7f979d275700 1 --2- 172.21.15.50:0/3386148590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f979808bab0 0x7f979808bee0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:07:53.702 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.700+0000 7f979d275700 1 -- 172.21.15.50:0/3386148590 shutdown_connections 2019-12-19T22:07:53.702 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.700+0000 7f979d275700 1 -- 172.21.15.50:0/3386148590 wait complete. 2019-12-19T22:07:53.702 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.700+0000 7f979d275700 1 -- 172.21.15.50:0/3386148590 >> 172.21.15.50:0/3386148590 conn(0x7f979808b220 msgr2=0x7f979808ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:07:53.711 INFO:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd new 57d4e31d-408e-4302-859d-7ea672b93772 1 2019-12-19T22:07:53.827 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.823+0000 7f147397a700 1 Processor -- start 2019-12-19T22:07:53.827 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.823+0000 7f147397a700 1 -- start start 2019-12-19T22:07:53.828 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.824+0000 7f147397a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f146c08f730 0x7f146c089380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:07:53.828 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.824+0000 7f147397a700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f146c08e2f0 con 0x7f146c07d9b0 2019-12-19T22:07:53.828 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.824+0000 7f147397a700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f146c08aed0 con 0x7f146c08f730 2019-12-19T22:07:53.828 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.824+0000 7f1471716700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f146c08f730 0x7f146c089380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:07:53.828 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.824+0000 7f1471f17700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f146c07d9b0 0x7f146c07dfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39452/0 (socket says 172.21.15.50:39452) 2019-12-19T22:07:53.828 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.824+0000 7f1471f17700 1 -- 172.21.15.50:0/659690106 learned_addr learned my addr 172.21.15.50:0/659690106 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:07:53.829 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.824+0000 7f1471716700 1 -- 172.21.15.50:0/659690106 >> v1:172.21.15.50:6789/0 conn(0x7f146c07d9b0 legacy=0x7f146c07dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:07:53.829 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.824+0000 7f1470f15700 1 -- 172.21.15.50:0/659690106 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2602760870 0 0) 0x7f146c08e2f0 con 0x7f146c07d9b0 2019-12-19T22:07:53.829 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.824+0000 7f1471716700 1 -- 172.21.15.50:0/659690106 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f146c08fb60 con 0x7f146c08f730 2019-12-19T22:07:53.829 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.824+0000 7f1471716700 1 --2- 172.21.15.50:0/659690106 >> v2:172.21.15.50:3300/0 conn(0x7f146c08f730 0x7f146c089380 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f14680032b0 tx=0x7f146800ff70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:53.829 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.824+0000 7f1471716700 1 --2- 172.21.15.50:0/659690106 >> v2:172.21.15.50:3300/0 conn(0x7f146c08f730 0x7f146c089380 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f14680032b0 tx=0x7f146800ff70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:53.829 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.824+0000 7f1471716700 1 --2- 172.21.15.50:0/659690106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f146c08f730 0x7f146c089380 secure :-1 s=READY pgs=14 cs=0 l=1 rx=0x7f14680032b0 tx=0x7f146800ff70).ready entity=mon.0 client_cookie=6e4de6aa3f8f6487 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:07:53.829 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.825+0000 7f1471716700 1 --2- 172.21.15.50:0/659690106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f146c08f730 0x7f146c089380 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7f14680032b0 tx=0x7f146800ff70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:53.830 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.825+0000 7f1470f15700 1 -- 172.21.15.50:0/659690106 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f1468011810 con 0x7f146c08f730 2019-12-19T22:07:53.830 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.825+0000 7f1471716700 1 --2- 172.21.15.50:0/659690106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f146c08f730 0x7f146c089380 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7f14680032b0 tx=0x7f146800ff70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:53.830 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.825+0000 7f1470f15700 1 -- 172.21.15.50:0/659690106 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1468011a10 con 0x7f146c08f730 2019-12-19T22:07:53.830 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.825+0000 7f1471716700 1 --2- 172.21.15.50:0/659690106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f146c08f730 0x7f146c089380 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7f14680032b0 tx=0x7f146800ff70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:53.830 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.825+0000 7f1470f15700 1 -- 172.21.15.50:0/659690106 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f1468011d70 con 0x7f146c08f730 2019-12-19T22:07:53.830 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.825+0000 7f147397a700 1 -- 172.21.15.50:0/659690106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f146c08f730 msgr2=0x7f146c089380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:07:53.830 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.825+0000 7f147397a700 1 --2- 172.21.15.50:0/659690106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f146c08f730 0x7f146c089380 secure :-1 s=READY pgs=14 cs=0 l=1 rx=0x7f14680032b0 tx=0x7f146800ff70).stop 2019-12-19T22:07:53.831 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.825+0000 7f147397a700 1 -- 172.21.15.50:0/659690106 shutdown_connections 2019-12-19T22:07:53.831 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.825+0000 7f147397a700 1 --2- 172.21.15.50:0/659690106 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f146c08f730 0x7f146c089380 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:07:53.831 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.825+0000 7f147397a700 1 -- 172.21.15.50:0/659690106 shutdown_connections 2019-12-19T22:07:53.831 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.825+0000 7f147397a700 1 -- 172.21.15.50:0/659690106 wait complete. 2019-12-19T22:07:53.831 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.825+0000 7f147397a700 1 -- 172.21.15.50:0/659690106 >> 172.21.15.50:0/659690106 conn(0x7f146c0924c0 msgr2=0x7f146c094900 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:07:53.831 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.826+0000 7f147397a700 1 Processor -- start 2019-12-19T22:07:53.831 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.826+0000 7f147397a700 1 -- start start 2019-12-19T22:07:53.835 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.826+0000 7f147397a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f146c084520 0x7f146c084950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:07:53.835 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.827+0000 7f147397a700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f146c086240 con 0x7f146c084ea0 2019-12-19T22:07:53.835 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.827+0000 7f147397a700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f146c091320 con 0x7f146c084520 2019-12-19T22:07:53.835 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.827+0000 7f1471f17700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f146c084520 0x7f146c084950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:07:53.838 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.827+0000 7f1471f17700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f146c084520 0x7f146c084950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53328/0 (socket says 172.21.15.50:53328) 2019-12-19T22:07:53.838 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.827+0000 7f1471f17700 1 -- 172.21.15.50:0/2872045289 learned_addr learned my addr 172.21.15.50:0/2872045289 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:07:53.838 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.827+0000 7f1471f17700 1 -- 172.21.15.50:0/2872045289 >> v1:172.21.15.50:6789/0 conn(0x7f146c084ea0 legacy=0x7f146c11f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:07:53.838 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.827+0000 7f1471f17700 1 -- 172.21.15.50:0/2872045289 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f146c082100 con 0x7f146c084520 2019-12-19T22:07:53.839 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.827+0000 7f1471f17700 1 --2- 172.21.15.50:0/2872045289 >> v2:172.21.15.50:3300/0 conn(0x7f146c084520 0x7f146c084950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f146c08f330 tx=0x7f1460010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:53.840 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.827+0000 7f1471f17700 1 --2- 172.21.15.50:0/2872045289 >> v2:172.21.15.50:3300/0 conn(0x7f146c084520 0x7f146c084950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f146c08f330 tx=0x7f1460010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:53.840 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.827+0000 7f1471f17700 1 --2- 172.21.15.50:0/2872045289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f146c084520 0x7f146c084950 secure :-1 s=READY pgs=16 cs=0 l=1 rx=0x7f146c08f330 tx=0x7f1460010920).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:07:53.841 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.827+0000 7f1471f17700 1 --2- 172.21.15.50:0/2872045289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f146c084520 0x7f146c084950 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7f146c08f330 tx=0x7f1460010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:53.841 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.827+0000 7f1471f17700 1 --2- 172.21.15.50:0/2872045289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f146c084520 0x7f146c084950 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7f146c08f330 tx=0x7f1460010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:53.841 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.827+0000 7f145e7fc700 1 -- 172.21.15.50:0/2872045289 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f1460011580 con 0x7f146c084520 2019-12-19T22:07:53.841 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.827+0000 7f1471f17700 1 --2- 172.21.15.50:0/2872045289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f146c084520 0x7f146c084950 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7f146c08f330 tx=0x7f1460010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:53.842 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.827+0000 7f145e7fc700 1 -- 172.21.15.50:0/2872045289 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1460011820 con 0x7f146c084520 2019-12-19T22:07:53.842 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.827+0000 7f147397a700 1 -- 172.21.15.50:0/2872045289 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f146c0852d0 con 0x7f146c084520 2019-12-19T22:07:53.842 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.827+0000 7f145e7fc700 1 -- 172.21.15.50:0/2872045289 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f1460011bc0 con 0x7f146c084520 2019-12-19T22:07:53.842 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.827+0000 7f1471f17700 1 --2- 172.21.15.50:0/2872045289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f146c084520 0x7f146c084950 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7f146c08f330 tx=0x7f1460010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:53.842 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.828+0000 7f147397a700 1 -- 172.21.15.50:0/2872045289 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f146c086a90 con 0x7f146c084520 2019-12-19T22:07:53.842 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.828+0000 7f145e7fc700 1 -- 172.21.15.50:0/2872045289 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 349+0+0 (secure 0 0 0) 0x7f146000a600 con 0x7f146c084520 2019-12-19T22:07:53.842 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.828+0000 7f1471f17700 1 --2- 172.21.15.50:0/2872045289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f146c084520 0x7f146c084950 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7f146c08f330 tx=0x7f1460010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:53.843 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.828+0000 7f145e7fc700 1 -- 172.21.15.50:0/2872045289 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7f146000a910 con 0x7f146c084520 2019-12-19T22:07:53.843 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.828+0000 7f147397a700 1 -- 172.21.15.50:0/2872045289 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f146c056340 con 0x7f146c084520 2019-12-19T22:07:53.843 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.830+0000 7f1471f17700 1 --2- 172.21.15.50:0/2872045289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f146c084520 0x7f146c084950 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7f146c08f330 tx=0x7f1460010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:53.843 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.831+0000 7f145e7fc700 1 -- 172.21.15.50:0/2872045289 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+66539 (secure 0 0 0) 0x7f146000baf0 con 0x7f146c084520 2019-12-19T22:07:53.969 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.967+0000 7f147397a700 1 -- 172.21.15.50:0/2872045289 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd new", "uuid": "57d4e31d-408e-4302-859d-7ea672b93772", "id": 1} v 0) v1 -- 0x7f146c08dea0 con 0x7f146c084520 2019-12-19T22:07:53.970 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.969+0000 7f1471f17700 1 --2- 172.21.15.50:0/2872045289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f146c084520 0x7f146c084950 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7f146c08f330 tx=0x7f1460010920).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:53.970 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.969+0000 7f145e7fc700 1 -- 172.21.15.50:0/2872045289 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "57d4e31d-408e-4302-859d-7ea672b93772", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f146000bd90 con 0x7f146c084520 2019-12-19T22:07:53.971 INFO:teuthology.orchestra.run.smithi050.stdout:1 2019-12-19T22:07:53.972 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.970+0000 7f147397a700 1 -- 172.21.15.50:0/2872045289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f146c084520 msgr2=0x7f146c084950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:07:53.972 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.970+0000 7f147397a700 1 --2- 172.21.15.50:0/2872045289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f146c084520 0x7f146c084950 secure :-1 s=READY pgs=16 cs=0 l=1 rx=0x7f146c08f330 tx=0x7f1460010920).stop 2019-12-19T22:07:53.972 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.970+0000 7f147397a700 1 -- 172.21.15.50:0/2872045289 shutdown_connections 2019-12-19T22:07:53.972 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.970+0000 7f147397a700 1 --2- 172.21.15.50:0/2872045289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f146c084520 0x7f146c084950 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:07:53.972 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.970+0000 7f147397a700 1 -- 172.21.15.50:0/2872045289 shutdown_connections 2019-12-19T22:07:53.972 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.970+0000 7f147397a700 1 -- 172.21.15.50:0/2872045289 wait complete. 2019-12-19T22:07:53.973 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:53.970+0000 7f147397a700 1 -- 172.21.15.50:0/2872045289 >> 172.21.15.50:0/2872045289 conn(0x7f146c08ff10 msgr2=0x7f146c08b220 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:07:53.981 INFO:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd new 600ea585-aa50-4596-9b14-090eab15f9a7 2 2019-12-19T22:07:54.099 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.095+0000 7f3bac21b700 1 Processor -- start 2019-12-19T22:07:54.099 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.095+0000 7f3bac21b700 1 -- start start 2019-12-19T22:07:54.100 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.095+0000 7f3bac21b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3ba407d9b0 0x7f3ba408f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:07:54.100 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.095+0000 7f3bac21b700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ba408e2f0 con 0x7f3ba407dfd0 2019-12-19T22:07:54.100 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.095+0000 7f3bac21b700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ba408aed0 con 0x7f3ba407d9b0 2019-12-19T22:07:54.100 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.095+0000 7f3ba9fb7700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3ba407dfd0 0x7f3ba4089380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39462/0 (socket says 172.21.15.50:39462) 2019-12-19T22:07:54.101 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.095+0000 7f3baa7b8700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3ba407d9b0 0x7f3ba408f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:07:54.101 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.095+0000 7f3ba9fb7700 1 -- 172.21.15.50:0/1411390822 learned_addr learned my addr 172.21.15.50:0/1411390822 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:07:54.101 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.096+0000 7f3baa7b8700 1 -- 172.21.15.50:0/1411390822 >> v1:172.21.15.50:6789/0 conn(0x7f3ba407dfd0 legacy=0x7f3ba4089380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:07:54.101 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.096+0000 7f3baa7b8700 1 -- 172.21.15.50:0/1411390822 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba408ebf0 con 0x7f3ba407d9b0 2019-12-19T22:07:54.101 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.096+0000 7f3baa7b8700 1 --2- 172.21.15.50:0/1411390822 >> v2:172.21.15.50:3300/0 conn(0x7f3ba407d9b0 0x7f3ba408f730 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3b98002f30 tx=0x7f3b9800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:54.101 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.096+0000 7f3baa7b8700 1 --2- 172.21.15.50:0/1411390822 >> v2:172.21.15.50:3300/0 conn(0x7f3ba407d9b0 0x7f3ba408f730 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3b98002f30 tx=0x7f3b9800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:54.101 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.096+0000 7f3baa7b8700 1 --2- 172.21.15.50:0/1411390822 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba407d9b0 0x7f3ba408f730 secure :-1 s=READY pgs=18 cs=0 l=1 rx=0x7f3b98002f30 tx=0x7f3b9800fbf0).ready entity=mon.0 client_cookie=e045e6d6995835b0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:07:54.102 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.096+0000 7f3baa7b8700 1 --2- 172.21.15.50:0/1411390822 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba407d9b0 0x7f3ba408f730 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f3b98002f30 tx=0x7f3b9800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:54.102 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.096+0000 7f3ba97b6700 1 -- 172.21.15.50:0/1411390822 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f3b98011230 con 0x7f3ba407d9b0 2019-12-19T22:07:54.103 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.096+0000 7f3baa7b8700 1 --2- 172.21.15.50:0/1411390822 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba407d9b0 0x7f3ba408f730 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f3b98002f30 tx=0x7f3b9800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:54.103 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.096+0000 7f3baa7b8700 1 --2- 172.21.15.50:0/1411390822 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba407d9b0 0x7f3ba408f730 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f3b98002f30 tx=0x7f3b9800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:54.103 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.096+0000 7f3ba97b6700 1 -- 172.21.15.50:0/1411390822 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b98011430 con 0x7f3ba407d9b0 2019-12-19T22:07:54.103 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.096+0000 7f3ba97b6700 1 -- 172.21.15.50:0/1411390822 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f3b98011790 con 0x7f3ba407d9b0 2019-12-19T22:07:54.103 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.096+0000 7f3bac21b700 1 -- 172.21.15.50:0/1411390822 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba407d9b0 msgr2=0x7f3ba408f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:07:54.104 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.096+0000 7f3bac21b700 1 --2- 172.21.15.50:0/1411390822 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba407d9b0 0x7f3ba408f730 secure :-1 s=READY pgs=18 cs=0 l=1 rx=0x7f3b98002f30 tx=0x7f3b9800fbf0).stop 2019-12-19T22:07:54.104 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.097+0000 7f3bac21b700 1 -- 172.21.15.50:0/1411390822 shutdown_connections 2019-12-19T22:07:54.104 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.097+0000 7f3bac21b700 1 --2- 172.21.15.50:0/1411390822 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba407d9b0 0x7f3ba408f730 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:07:54.104 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.097+0000 7f3bac21b700 1 -- 172.21.15.50:0/1411390822 shutdown_connections 2019-12-19T22:07:54.104 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.097+0000 7f3bac21b700 1 -- 172.21.15.50:0/1411390822 wait complete. 2019-12-19T22:07:54.104 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.097+0000 7f3bac21b700 1 -- 172.21.15.50:0/1411390822 >> 172.21.15.50:0/1411390822 conn(0x7f3ba40924c0 msgr2=0x7f3ba4094900 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:07:54.105 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.098+0000 7f3bac21b700 1 Processor -- start 2019-12-19T22:07:54.105 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.098+0000 7f3bac21b700 1 -- start start 2019-12-19T22:07:54.108 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.098+0000 7f3bac21b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3ba40832a0 0x7f3ba40836d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:07:54.114 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.098+0000 7f3bac21b700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ba40859d0 con 0x7f3ba4083c20 2019-12-19T22:07:54.114 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.098+0000 7f3bac21b700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ba40853c0 con 0x7f3ba40832a0 2019-12-19T22:07:54.114 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.099+0000 7f3baa7b8700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3ba40832a0 0x7f3ba40836d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:07:54.114 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.099+0000 7f3baa7b8700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3ba40832a0 0x7f3ba40836d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53336/0 (socket says 172.21.15.50:53336) 2019-12-19T22:07:54.114 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.099+0000 7f3baa7b8700 1 -- 172.21.15.50:0/1145911936 learned_addr learned my addr 172.21.15.50:0/1145911936 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:07:54.114 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.099+0000 7f3baa7b8700 1 -- 172.21.15.50:0/1145911936 >> v1:172.21.15.50:6789/0 conn(0x7f3ba4083c20 legacy=0x7f3ba4122640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:07:54.115 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.099+0000 7f3baa7b8700 1 -- 172.21.15.50:0/1145911936 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba40818a0 con 0x7f3ba40832a0 2019-12-19T22:07:54.115 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.099+0000 7f3baa7b8700 1 --2- 172.21.15.50:0/1145911936 >> v2:172.21.15.50:3300/0 conn(0x7f3ba40832a0 0x7f3ba40836d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3b98002f30 tx=0x7f3b9800f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:54.115 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.099+0000 7f3baa7b8700 1 --2- 172.21.15.50:0/1145911936 >> v2:172.21.15.50:3300/0 conn(0x7f3ba40832a0 0x7f3ba40836d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3b98002f30 tx=0x7f3b9800f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:54.115 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.099+0000 7f3baa7b8700 1 --2- 172.21.15.50:0/1145911936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba40832a0 0x7f3ba40836d0 secure :-1 s=READY pgs=20 cs=0 l=1 rx=0x7f3b98002f30 tx=0x7f3b9800f780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:07:54.115 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.099+0000 7f3baa7b8700 1 --2- 172.21.15.50:0/1145911936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba40832a0 0x7f3ba40836d0 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f3b98002f30 tx=0x7f3b9800f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:54.115 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.099+0000 7f3baa7b8700 1 --2- 172.21.15.50:0/1145911936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba40832a0 0x7f3ba40836d0 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f3b98002f30 tx=0x7f3b9800f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:54.116 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.099+0000 7f3b96ffd700 1 -- 172.21.15.50:0/1145911936 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f3b98007280 con 0x7f3ba40832a0 2019-12-19T22:07:54.116 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.099+0000 7f3baa7b8700 1 --2- 172.21.15.50:0/1145911936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba40832a0 0x7f3ba40836d0 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f3b98002f30 tx=0x7f3b9800f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:54.116 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.099+0000 7f3b96ffd700 1 -- 172.21.15.50:0/1145911936 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b98011440 con 0x7f3ba40832a0 2019-12-19T22:07:54.116 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.099+0000 7f3bac21b700 1 -- 172.21.15.50:0/1145911936 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ba4084050 con 0x7f3ba40832a0 2019-12-19T22:07:54.116 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.099+0000 7f3b96ffd700 1 -- 172.21.15.50:0/1145911936 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f3b98011760 con 0x7f3ba40832a0 2019-12-19T22:07:54.116 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.099+0000 7f3bac21b700 1 -- 172.21.15.50:0/1145911936 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ba4084360 con 0x7f3ba40832a0 2019-12-19T22:07:54.117 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.099+0000 7f3baa7b8700 1 --2- 172.21.15.50:0/1145911936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba40832a0 0x7f3ba40836d0 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f3b98002f30 tx=0x7f3b9800f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:54.117 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.099+0000 7f3baa7b8700 1 --2- 172.21.15.50:0/1145911936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba40832a0 0x7f3ba40836d0 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f3b98002f30 tx=0x7f3b9800f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:54.118 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.099+0000 7f3b96ffd700 1 -- 172.21.15.50:0/1145911936 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 349+0+0 (secure 0 0 0) 0x7f3b980058e0 con 0x7f3ba40832a0 2019-12-19T22:07:54.118 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.099+0000 7f3b96ffd700 1 -- 172.21.15.50:0/1145911936 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7f3b9800dca0 con 0x7f3ba40832a0 2019-12-19T22:07:54.118 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.100+0000 7f3bac21b700 1 -- 172.21.15.50:0/1145911936 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ba4056340 con 0x7f3ba40832a0 2019-12-19T22:07:54.118 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.102+0000 7f3baa7b8700 1 --2- 172.21.15.50:0/1145911936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba40832a0 0x7f3ba40836d0 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f3b98002f30 tx=0x7f3b9800f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:54.118 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.102+0000 7f3b96ffd700 1 -- 172.21.15.50:0/1145911936 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+66539 (secure 0 0 0) 0x7f3ba40818a0 con 0x7f3ba40832a0 2019-12-19T22:07:54.201 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.197+0000 7f3bac21b700 1 -- 172.21.15.50:0/1145911936 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd new", "uuid": "600ea585-aa50-4596-9b14-090eab15f9a7", "id": 2} v 0) v1 -- 0x7f3ba40848e0 con 0x7f3ba40832a0 2019-12-19T22:07:54.201 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.199+0000 7f3baa7b8700 1 --2- 172.21.15.50:0/1145911936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba40832a0 0x7f3ba40836d0 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f3b98002f30 tx=0x7f3b9800f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:54.201 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.199+0000 7f3b96ffd700 1 -- 172.21.15.50:0/1145911936 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "600ea585-aa50-4596-9b14-090eab15f9a7", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3b9800d400 con 0x7f3ba40832a0 2019-12-19T22:07:54.201 INFO:teuthology.orchestra.run.smithi050.stdout:2 2019-12-19T22:07:54.202 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.200+0000 7f3bac21b700 1 -- 172.21.15.50:0/1145911936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba40832a0 msgr2=0x7f3ba40836d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:07:54.202 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.200+0000 7f3bac21b700 1 --2- 172.21.15.50:0/1145911936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba40832a0 0x7f3ba40836d0 secure :-1 s=READY pgs=20 cs=0 l=1 rx=0x7f3b98002f30 tx=0x7f3b9800f780).stop 2019-12-19T22:07:54.203 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.200+0000 7f3bac21b700 1 -- 172.21.15.50:0/1145911936 shutdown_connections 2019-12-19T22:07:54.203 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.200+0000 7f3bac21b700 1 --2- 172.21.15.50:0/1145911936 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3ba40832a0 0x7f3ba40836d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:07:54.203 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.200+0000 7f3bac21b700 1 -- 172.21.15.50:0/1145911936 shutdown_connections 2019-12-19T22:07:54.203 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.200+0000 7f3bac21b700 1 -- 172.21.15.50:0/1145911936 wait complete. 2019-12-19T22:07:54.203 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:07:54.200+0000 7f3bac21b700 1 -- 172.21.15.50:0/1145911936 >> 172.21.15.50:0/1145911936 conn(0x7f3ba408cf30 msgr2=0x7f3ba408b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:07:54.211 INFO:tasks.ceph.osd.0:Restarting daemon 2019-12-19T22:07:54.212 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2019-12-19T22:07:54.214 INFO:tasks.ceph.osd.0:Started 2019-12-19T22:07:54.214 INFO:tasks.ceph.osd.1:Restarting daemon 2019-12-19T22:07:54.214 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2019-12-19T22:07:54.216 INFO:tasks.ceph.osd.1:Started 2019-12-19T22:07:54.216 INFO:tasks.ceph.osd.2:Restarting daemon 2019-12-19T22:07:54.216 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2019-12-19T22:07:54.223 INFO:tasks.ceph.osd.2:Started 2019-12-19T22:07:54.223 INFO:tasks.ceph:Waiting for OSDs to come up 2019-12-19T22:07:54.526 INFO:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2019-12-19T22:07:54.635 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.623+0000 7f56931e6700 1 Processor -- start 2019-12-19T22:07:54.636 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.623+0000 7f56931e6700 1 -- start start 2019-12-19T22:07:54.636 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.623+0000 7f56931e6700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f568c07f860 0x7f568c07fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:07:54.636 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.623+0000 7f56931e6700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f568c069360 con 0x7f568c0801e0 2019-12-19T22:07:54.636 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.623+0000 7f56931e6700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f568c062ba0 con 0x7f568c07f860 2019-12-19T22:07:54.636 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.623+0000 7f56929e5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f568c07f860 0x7f568c07fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:07:54.637 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.623+0000 7f56921e4700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f568c0801e0 0x7f568c07c340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39480/0 (socket says 172.21.15.50:39480) 2019-12-19T22:07:54.637 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.623+0000 7f56921e4700 1 -- 172.21.15.50:0/2970279071 learned_addr learned my addr 172.21.15.50:0/2970279071 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:07:54.637 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.624+0000 7f56929e5700 1 -- 172.21.15.50:0/2970279071 >> v1:172.21.15.50:6789/0 conn(0x7f568c0801e0 legacy=0x7f568c07c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:07:54.643 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.624+0000 7f56919e3700 1 -- 172.21.15.50:0/2970279071 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 53817886 0 0) 0x7f568c069360 con 0x7f568c0801e0 2019-12-19T22:07:54.643 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.624+0000 7f56929e5700 1 -- 172.21.15.50:0/2970279071 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f568c063c50 con 0x7f568c07f860 2019-12-19T22:07:54.643 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.624+0000 7f56929e5700 1 --2- 172.21.15.50:0/2970279071 >> v2:172.21.15.50:3300/0 conn(0x7f568c07f860 0x7f568c07fc90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5688008790 tx=0x7f568800fc50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:54.643 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.624+0000 7f56929e5700 1 --2- 172.21.15.50:0/2970279071 >> v2:172.21.15.50:3300/0 conn(0x7f568c07f860 0x7f568c07fc90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5688008790 tx=0x7f568800fc50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:54.643 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.624+0000 7f56929e5700 1 --2- 172.21.15.50:0/2970279071 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f568c07f860 0x7f568c07fc90 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7f5688008790 tx=0x7f568800fc50).ready entity=mon.0 client_cookie=70750525e377aa95 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:07:54.644 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.624+0000 7f56929e5700 1 --2- 172.21.15.50:0/2970279071 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f568c07f860 0x7f568c07fc90 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f5688008790 tx=0x7f568800fc50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:54.644 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.624+0000 7f56919e3700 1 -- 172.21.15.50:0/2970279071 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f5688008a30 con 0x7f568c07f860 2019-12-19T22:07:54.644 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.624+0000 7f56929e5700 1 --2- 172.21.15.50:0/2970279071 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f568c07f860 0x7f568c07fc90 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f5688008790 tx=0x7f568800fc50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:54.645 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.624+0000 7f56929e5700 1 --2- 172.21.15.50:0/2970279071 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f568c07f860 0x7f568c07fc90 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f5688008790 tx=0x7f568800fc50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:54.645 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.624+0000 7f56919e3700 1 -- 172.21.15.50:0/2970279071 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5688008c30 con 0x7f568c07f860 2019-12-19T22:07:54.645 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.624+0000 7f56919e3700 1 -- 172.21.15.50:0/2970279071 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f5688011700 con 0x7f568c07f860 2019-12-19T22:07:54.645 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.624+0000 7f56931e6700 1 -- 172.21.15.50:0/2970279071 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f568c07f860 msgr2=0x7f568c07fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:07:54.645 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.624+0000 7f56931e6700 1 --2- 172.21.15.50:0/2970279071 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f568c07f860 0x7f568c07fc90 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7f5688008790 tx=0x7f568800fc50).stop 2019-12-19T22:07:54.645 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.625+0000 7f56931e6700 1 -- 172.21.15.50:0/2970279071 shutdown_connections 2019-12-19T22:07:54.646 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.625+0000 7f56931e6700 1 --2- 172.21.15.50:0/2970279071 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f568c07f860 0x7f568c07fc90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:07:54.646 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.625+0000 7f56931e6700 1 -- 172.21.15.50:0/2970279071 shutdown_connections 2019-12-19T22:07:54.646 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.625+0000 7f56931e6700 1 -- 172.21.15.50:0/2970279071 wait complete. 2019-12-19T22:07:54.646 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.625+0000 7f56931e6700 1 -- 172.21.15.50:0/2970279071 >> 172.21.15.50:0/2970279071 conn(0x7f568c095730 msgr2=0x7f568c095b60 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:07:54.646 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.626+0000 7f56931e6700 1 Processor -- start 2019-12-19T22:07:54.646 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.626+0000 7f56931e6700 1 -- start start 2019-12-19T22:07:54.647 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.626+0000 7f56931e6700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f568c079010 0x7f568c126950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:07:54.647 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.626+0000 7f56931e6700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f568c07b950 con 0x7f568c060860 2019-12-19T22:07:54.647 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.626+0000 7f56931e6700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f568c0612c0 con 0x7f568c079010 2019-12-19T22:07:54.647 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.626+0000 7f56929e5700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f568c060860 0x7f568c078810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39482/0 (socket says 172.21.15.50:39482) 2019-12-19T22:07:54.647 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.626+0000 7f56921e4700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f568c079010 0x7f568c126950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:07:54.647 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.626+0000 7f56929e5700 1 -- 172.21.15.50:0/349785838 learned_addr learned my addr 172.21.15.50:0/349785838 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:07:54.647 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.627+0000 7f56837fe700 1 -- 172.21.15.50:0/349785838 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1316864464 0 0) 0x7f568c07b950 con 0x7f568c060860 2019-12-19T22:07:54.648 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.627+0000 7f56837fe700 1 -- 172.21.15.50:0/349785838 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56740030b0 con 0x7f568c060860 2019-12-19T22:07:54.648 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.627+0000 7f56921e4700 1 -- 172.21.15.50:0/349785838 >> v1:172.21.15.50:6789/0 conn(0x7f568c060860 legacy=0x7f568c078810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:07:54.653 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.627+0000 7f56921e4700 1 -- 172.21.15.50:0/349785838 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f568c07bc90 con 0x7f568c079010 2019-12-19T22:07:54.653 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.627+0000 7f56921e4700 1 --2- 172.21.15.50:0/349785838 >> v2:172.21.15.50:3300/0 conn(0x7f568c079010 0x7f568c126950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f567c0043a0 tx=0x7f567c010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:54.653 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.627+0000 7f56921e4700 1 --2- 172.21.15.50:0/349785838 >> v2:172.21.15.50:3300/0 conn(0x7f568c079010 0x7f568c126950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f567c0043a0 tx=0x7f567c010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:54.653 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.627+0000 7f56921e4700 1 --2- 172.21.15.50:0/349785838 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f568c079010 0x7f568c126950 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7f567c0043a0 tx=0x7f567c010820).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:07:54.653 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.627+0000 7f56921e4700 1 --2- 172.21.15.50:0/349785838 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f568c079010 0x7f568c126950 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f567c0043a0 tx=0x7f567c010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:54.654 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.627+0000 7f56837fe700 1 -- 172.21.15.50:0/349785838 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f567c0114c0 con 0x7f568c079010 2019-12-19T22:07:54.654 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.627+0000 7f56921e4700 1 --2- 172.21.15.50:0/349785838 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f568c079010 0x7f568c126950 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f567c0043a0 tx=0x7f567c010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:54.654 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.627+0000 7f56921e4700 1 --2- 172.21.15.50:0/349785838 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f568c079010 0x7f568c126950 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f567c0043a0 tx=0x7f567c010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:54.654 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.627+0000 7f56837fe700 1 -- 172.21.15.50:0/349785838 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f567c0116c0 con 0x7f568c079010 2019-12-19T22:07:54.654 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.627+0000 7f56931e6700 1 -- 172.21.15.50:0/349785838 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f568c07a720 con 0x7f568c079010 2019-12-19T22:07:54.654 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.627+0000 7f56837fe700 1 -- 172.21.15.50:0/349785838 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f567c0119e0 con 0x7f568c079010 2019-12-19T22:07:54.654 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.627+0000 7f56931e6700 1 -- 172.21.15.50:0/349785838 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f568c072c90 con 0x7f568c079010 2019-12-19T22:07:54.656 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.627+0000 7f56921e4700 1 --2- 172.21.15.50:0/349785838 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f568c079010 0x7f568c126950 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f567c0043a0 tx=0x7f567c010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:54.656 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.627+0000 7f56837fe700 1 -- 172.21.15.50:0/349785838 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 1) v1 ==== 349+0+0 (secure 0 0 0) 0x7f567c00b500 con 0x7f568c079010 2019-12-19T22:07:54.656 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.627+0000 7f56921e4700 1 --2- 172.21.15.50:0/349785838 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f568c079010 0x7f568c126950 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f567c0043a0 tx=0x7f567c010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:54.662 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.627+0000 7f56837fe700 1 -- 172.21.15.50:0/349785838 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (secure 0 0 0) 0x7f567c00bdb0 con 0x7f568c079010 2019-12-19T22:07:54.662 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.628+0000 7f56931e6700 1 -- 172.21.15.50:0/349785838 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f568c056340 con 0x7f568c079010 2019-12-19T22:07:54.662 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.630+0000 7f56921e4700 1 --2- 172.21.15.50:0/349785838 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f568c079010 0x7f568c126950 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f567c0043a0 tx=0x7f567c010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:54.662 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.630+0000 7f56837fe700 1 -- 172.21.15.50:0/349785838 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+66539 (secure 0 0 0) 0x7f567c009260 con 0x7f568c079010 2019-12-19T22:07:54.706 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.704+0000 7f56931e6700 1 -- 172.21.15.50:0/349785838 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f568c07ae50 con 0x7f568c079010 2019-12-19T22:07:54.707 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.704+0000 7f56921e4700 1 --2- 172.21.15.50:0/349785838 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f568c079010 0x7f568c126950 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7f567c0043a0 tx=0x7f567c010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:07:54.708 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.704+0000 7f56837fe700 1 -- 172.21.15.50:0/349785838 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v5) v1 ==== 74+0+3218 (secure 0 0 0) 0x7f567c009500 con 0x7f568c079010 2019-12-19T22:07:54.708 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.705+0000 7f56931e6700 1 -- 172.21.15.50:0/349785838 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f568c079010 msgr2=0x7f568c126950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:07:54.708 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.705+0000 7f56931e6700 1 --2- 172.21.15.50:0/349785838 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f568c079010 0x7f568c126950 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7f567c0043a0 tx=0x7f567c010820).stop 2019-12-19T22:07:54.709 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.705+0000 7f56931e6700 1 -- 172.21.15.50:0/349785838 shutdown_connections 2019-12-19T22:07:54.709 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.705+0000 7f56931e6700 1 --2- 172.21.15.50:0/349785838 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f568c079010 0x7f568c126950 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:07:54.709 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.705+0000 7f56931e6700 1 -- 172.21.15.50:0/349785838 shutdown_connections 2019-12-19T22:07:54.710 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.705+0000 7f56931e6700 1 -- 172.21.15.50:0/349785838 wait complete. 2019-12-19T22:07:54.710 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:07:54.705+0000 7f56931e6700 1 -- 172.21.15.50:0/349785838 >> 172.21.15.50:0/349785838 conn(0x7f568c0623a0 msgr2=0x7f568c07c340 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:07:54.710 INFO:teuthology.misc.health.smithi050.stdout: 2019-12-19T22:07:54.711 INFO:teuthology.misc.health.smithi050.stdout:{"epoch":5,"fsid":"c1382993-41cc-4b35-a402-c17778701f01","created":"2019-12-19T22:07:52.345475+0000","modified":"2019-12-19T22:07:54.198514+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"6137ed8c-8e2c-4e88-8634-dc763bed14c8","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"57d4e31d-408e-4302-859d-7ea672b93772","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"600ea585-aa50-4596-9b14-090eab15f9a7","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-19T22:07:54.716 DEBUG:teuthology.misc:0 of 3 OSDs are up 2019-12-19T22:07:54.823 INFO:tasks.ceph.osd.1.smithi050.stderr:2019-12-19T22:07:54.821+0000 7fe6f284dec0 -1 Falling back to public interface 2019-12-19T22:07:54.823 INFO:tasks.ceph.osd.2.smithi050.stderr:2019-12-19T22:07:54.821+0000 7f1fa2576ec0 -1 Falling back to public interface 2019-12-19T22:07:54.824 INFO:tasks.ceph.osd.2.smithi050.stderr:2019-12-19T22:07:54.822+0000 7f1f9cfe2700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6810/0: (98) Address already in use 2019-12-19T22:07:54.826 INFO:tasks.ceph.osd.0.smithi050.stderr:2019-12-19T22:07:54.823+0000 7fbe20f40ec0 -1 Falling back to public interface 2019-12-19T22:07:55.119 INFO:tasks.ceph.osd.2.smithi050.stderr:2019-12-19T22:07:55.118+0000 7f1fa2576ec0 -1 osd.2 0 log_to_monitors {default=true} 2019-12-19T22:07:55.369 INFO:tasks.ceph.osd.1.smithi050.stderr:2019-12-19T22:07:55.368+0000 7fe6f284dec0 -1 osd.1 0 log_to_monitors {default=true} 2019-12-19T22:07:55.374 INFO:tasks.ceph.osd.0.smithi050.stderr:2019-12-19T22:07:55.372+0000 7fbe20f40ec0 -1 osd.0 0 log_to_monitors {default=true} 2019-12-19T22:07:56.357 INFO:tasks.ceph.osd.2.smithi050.stderr:2019-12-19T22:07:56.356+0000 7f1f8b536700 -1 osd.2 0 waiting for initial osdmap 2019-12-19T22:07:57.362 INFO:tasks.ceph.osd.0.smithi050.stderr:2019-12-19T22:07:57.360+0000 7fbe05ef8700 -1 osd.0 0 waiting for initial osdmap 2019-12-19T22:07:57.362 INFO:tasks.ceph.osd.1.smithi050.stderr:2019-12-19T22:07:57.360+0000 7fe6d7805700 -1 osd.1 0 waiting for initial osdmap 2019-12-19T22:08:01.020 INFO:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2019-12-19T22:08:01.135 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.128+0000 7ff3e822b700 1 Processor -- start 2019-12-19T22:08:01.135 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.128+0000 7ff3e822b700 1 -- start start 2019-12-19T22:08:01.135 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.129+0000 7ff3e822b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff3e007dd90 0x7ff3e007e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:01.135 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.129+0000 7ff3e822b700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3e008f980 con 0x7ff3e00890b0 2019-12-19T22:08:01.135 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.129+0000 7ff3e822b700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3e008dec0 con 0x7ff3e007dd90 2019-12-19T22:08:01.136 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.129+0000 7ff3e67c8700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff3e007dd90 0x7ff3e007e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:01.136 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.129+0000 7ff3e5fc7700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff3e00890b0 0x7ff3e00894e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39532/0 (socket says 172.21.15.50:39532) 2019-12-19T22:08:01.136 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.129+0000 7ff3e67c8700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff3e007dd90 0x7ff3e007e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53404/0 (socket says 172.21.15.50:53404) 2019-12-19T22:08:01.136 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.129+0000 7ff3e5fc7700 1 -- 172.21.15.50:0/491341256 learned_addr learned my addr 172.21.15.50:0/491341256 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:01.136 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.129+0000 7ff3e67c8700 1 -- 172.21.15.50:0/491341256 >> v1:172.21.15.50:6789/0 conn(0x7ff3e00890b0 legacy=0x7ff3e00894e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:01.136 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.129+0000 7ff3e57c6700 1 -- 172.21.15.50:0/491341256 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3938150041 0 0) 0x7ff3e008f980 con 0x7ff3e00890b0 2019-12-19T22:08:01.136 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.129+0000 7ff3e67c8700 1 -- 172.21.15.50:0/491341256 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e0069360 con 0x7ff3e007dd90 2019-12-19T22:08:01.137 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.129+0000 7ff3e67c8700 1 --2- 172.21.15.50:0/491341256 >> v2:172.21.15.50:3300/0 conn(0x7ff3e007dd90 0x7ff3e007e1c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff3dc008790 tx=0x7ff3dc00fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:01.137 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.129+0000 7ff3e67c8700 1 --2- 172.21.15.50:0/491341256 >> v2:172.21.15.50:3300/0 conn(0x7ff3e007dd90 0x7ff3e007e1c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff3dc008790 tx=0x7ff3dc00fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:01.137 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.129+0000 7ff3e67c8700 1 --2- 172.21.15.50:0/491341256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3e007dd90 0x7ff3e007e1c0 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7ff3dc008790 tx=0x7ff3dc00fbf0).ready entity=mon.0 client_cookie=1ced4ebbcbe355ab server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:01.137 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.129+0000 7ff3e67c8700 1 --2- 172.21.15.50:0/491341256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3e007dd90 0x7ff3e007e1c0 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7ff3dc008790 tx=0x7ff3dc00fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:01.137 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.129+0000 7ff3e57c6700 1 -- 172.21.15.50:0/491341256 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7ff3dc011270 con 0x7ff3e007dd90 2019-12-19T22:08:01.137 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.129+0000 7ff3e67c8700 1 --2- 172.21.15.50:0/491341256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3e007dd90 0x7ff3e007e1c0 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7ff3dc008790 tx=0x7ff3dc00fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:01.137 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.129+0000 7ff3e57c6700 1 -- 172.21.15.50:0/491341256 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3dc011470 con 0x7ff3e007dd90 2019-12-19T22:08:01.138 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.129+0000 7ff3e67c8700 1 --2- 172.21.15.50:0/491341256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3e007dd90 0x7ff3e007e1c0 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7ff3dc008790 tx=0x7ff3dc00fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:01.138 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.129+0000 7ff3e57c6700 1 -- 172.21.15.50:0/491341256 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7ff3dc011790 con 0x7ff3e007dd90 2019-12-19T22:08:01.138 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.129+0000 7ff3e822b700 1 -- 172.21.15.50:0/491341256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3e007dd90 msgr2=0x7ff3e007e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:01.138 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.129+0000 7ff3e822b700 1 --2- 172.21.15.50:0/491341256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3e007dd90 0x7ff3e007e1c0 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7ff3dc008790 tx=0x7ff3dc00fbf0).stop 2019-12-19T22:08:01.138 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.130+0000 7ff3e822b700 1 -- 172.21.15.50:0/491341256 shutdown_connections 2019-12-19T22:08:01.138 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.130+0000 7ff3e822b700 1 --2- 172.21.15.50:0/491341256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3e007dd90 0x7ff3e007e1c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:01.138 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.130+0000 7ff3e822b700 1 -- 172.21.15.50:0/491341256 shutdown_connections 2019-12-19T22:08:01.139 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.130+0000 7ff3e822b700 1 -- 172.21.15.50:0/491341256 wait complete. 2019-12-19T22:08:01.139 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.130+0000 7ff3e822b700 1 -- 172.21.15.50:0/491341256 >> 172.21.15.50:0/491341256 conn(0x7ff3e0094540 msgr2=0x7ff3e0094970 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:01.139 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.131+0000 7ff3e822b700 1 Processor -- start 2019-12-19T22:08:01.139 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.131+0000 7ff3e822b700 1 -- start start 2019-12-19T22:08:01.139 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.131+0000 7ff3e822b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff3e0089920 0x7ff3e00630e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:01.139 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.131+0000 7ff3e822b700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3e0064000 con 0x7ff3e0060510 2019-12-19T22:08:01.139 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.131+0000 7ff3e822b700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3e0062a60 con 0x7ff3e0089920 2019-12-19T22:08:01.140 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.131+0000 7ff3e67c8700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff3e0089920 0x7ff3e00630e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:01.140 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.132+0000 7ff3e67c8700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff3e0089920 0x7ff3e00630e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53408/0 (socket says 172.21.15.50:53408) 2019-12-19T22:08:01.140 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.132+0000 7ff3e67c8700 1 -- 172.21.15.50:0/2774520927 learned_addr learned my addr 172.21.15.50:0/2774520927 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:01.140 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.132+0000 7ff3e67c8700 1 -- 172.21.15.50:0/2774520927 >> v1:172.21.15.50:6789/0 conn(0x7ff3e0060510 legacy=0x7ff3e0060940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:01.142 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.132+0000 7ff3e67c8700 1 -- 172.21.15.50:0/2774520927 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e00626a0 con 0x7ff3e0089920 2019-12-19T22:08:01.143 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.132+0000 7ff3e67c8700 1 --2- 172.21.15.50:0/2774520927 >> v2:172.21.15.50:3300/0 conn(0x7ff3e0089920 0x7ff3e00630e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff3dc008790 tx=0x7ff3dc011770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:01.143 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.132+0000 7ff3e67c8700 1 --2- 172.21.15.50:0/2774520927 >> v2:172.21.15.50:3300/0 conn(0x7ff3e0089920 0x7ff3e00630e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff3dc008790 tx=0x7ff3dc011770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:01.143 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.132+0000 7ff3e67c8700 1 --2- 172.21.15.50:0/2774520927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3e0089920 0x7ff3e00630e0 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7ff3dc008790 tx=0x7ff3dc011770).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:01.143 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.132+0000 7ff3e67c8700 1 --2- 172.21.15.50:0/2774520927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3e0089920 0x7ff3e00630e0 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7ff3dc008790 tx=0x7ff3dc011770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:01.144 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.132+0000 7ff3e67c8700 1 --2- 172.21.15.50:0/2774520927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3e0089920 0x7ff3e00630e0 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7ff3dc008790 tx=0x7ff3dc011770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:01.144 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.132+0000 7ff3d6ffd700 1 -- 172.21.15.50:0/2774520927 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7ff3dc007280 con 0x7ff3e0089920 2019-12-19T22:08:01.144 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.132+0000 7ff3e67c8700 1 --2- 172.21.15.50:0/2774520927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3e0089920 0x7ff3e00630e0 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7ff3dc008790 tx=0x7ff3dc011770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:01.145 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.132+0000 7ff3d6ffd700 1 -- 172.21.15.50:0/2774520927 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3dc005540 con 0x7ff3e0089920 2019-12-19T22:08:01.145 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.132+0000 7ff3e822b700 1 -- 172.21.15.50:0/2774520927 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3e0062cb0 con 0x7ff3e0089920 2019-12-19T22:08:01.145 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.132+0000 7ff3d6ffd700 1 -- 172.21.15.50:0/2774520927 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7ff3dc0058a0 con 0x7ff3e0089920 2019-12-19T22:08:01.145 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.132+0000 7ff3e822b700 1 -- 172.21.15.50:0/2774520927 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3e0061960 con 0x7ff3e0089920 2019-12-19T22:08:01.145 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.132+0000 7ff3e67c8700 1 --2- 172.21.15.50:0/2774520927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3e0089920 0x7ff3e00630e0 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7ff3dc008790 tx=0x7ff3dc011770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:01.145 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.133+0000 7ff3d6ffd700 1 -- 172.21.15.50:0/2774520927 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7ff3dc005bb0 con 0x7ff3e0089920 2019-12-19T22:08:01.145 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.133+0000 7ff3e67c8700 1 --2- 172.21.15.50:0/2774520927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3e0089920 0x7ff3e00630e0 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7ff3dc008790 tx=0x7ff3dc011770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:01.146 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.133+0000 7ff3d6ffd700 1 --2- 172.21.15.50:0/2774520927 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7ff3c801fa80 0x7ff3c8021f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:01.146 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.133+0000 7ff3d6ffd700 1 -- 172.21.15.50:0/2774520927 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 2230+0+0 (secure 0 0 0) 0x7ff3dc02f200 con 0x7ff3e0089920 2019-12-19T22:08:01.146 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.133+0000 7ff3e5fc7700 1 --2- 172.21.15.50:0/2774520927 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7ff3c801fa80 0x7ff3c8021f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:01.146 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.133+0000 7ff3e5fc7700 1 --2- 172.21.15.50:0/2774520927 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7ff3c801fa80 0x7ff3c8021f90 crc :-1 s=READY pgs=9 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:01.146 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.134+0000 7ff3e822b700 1 -- 172.21.15.50:0/2774520927 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3e0056340 con 0x7ff3e0089920 2019-12-19T22:08:01.147 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.137+0000 7ff3e67c8700 1 --2- 172.21.15.50:0/2774520927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3e0089920 0x7ff3e00630e0 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7ff3dc008790 tx=0x7ff3dc011770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:01.147 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.137+0000 7ff3d6ffd700 1 -- 172.21.15.50:0/2774520927 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7ff3e00626a0 con 0x7ff3e0089920 2019-12-19T22:08:01.277 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.276+0000 7ff3e822b700 1 -- 172.21.15.50:0/2774520927 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3e008a270 con 0x7ff3e0089920 2019-12-19T22:08:01.278 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.276+0000 7ff3e67c8700 1 --2- 172.21.15.50:0/2774520927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3e0089920 0x7ff3e00630e0 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7ff3dc008790 tx=0x7ff3dc011770).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:01.278 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.277+0000 7ff3d6ffd700 1 -- 172.21.15.50:0/2774520927 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+4573 (secure 0 0 0) 0x7ff3e0069360 con 0x7ff3e0089920 2019-12-19T22:08:01.278 INFO:teuthology.misc.health.smithi050.stdout: 2019-12-19T22:08:01.279 INFO:teuthology.misc.health.smithi050.stdout:{"epoch":10,"fsid":"c1382993-41cc-4b35-a402-c17778701f01","created":"2019-12-19T22:07:52.345475+0000","modified":"2019-12-19T22:07:59.360293+0000","last_up_change":"2019-12-19T22:07:58.357117+0000","last_in_change":"2019-12-19T22:07:58.357117+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"6137ed8c-8e2c-4e88-8634-dc763bed14c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":27757},{"type":"v1","addr":"172.21.15.50:6817","nonce":27757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":27757},{"type":"v1","addr":"172.21.15.50:6819","nonce":27757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":27757},{"type":"v1","addr":"172.21.15.50:6823","nonce":27757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":27757},{"type":"v1","addr":"172.21.15.50:6821","nonce":27757}]},"public_addr":"172.21.15.50:6817/27757","cluster_addr":"172.21.15.50:6819/27757","heartbeat_back_addr":"172.21.15.50:6823/27757","heartbeat_front_addr":"172.21.15.50:6821/27757","state":["exists","up"]},{"osd":1,"uuid":"57d4e31d-408e-4302-859d-7ea672b93772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":27758},{"type":"v1","addr":"172.21.15.50:6801","nonce":27758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":27758},{"type":"v1","addr":"172.21.15.50:6803","nonce":27758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":27758},{"type":"v1","addr":"172.21.15.50:6810","nonce":27758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6805","nonce":27758},{"type":"v1","addr":"172.21.15.50:6807","nonce":27758}]},"public_addr":"172.21.15.50:6801/27758","cluster_addr":"172.21.15.50:6803/27758","heartbeat_back_addr":"172.21.15.50:6810/27758","heartbeat_front_addr":"172.21.15.50:6807/27758","state":["exists","up"]},{"osd":2,"uuid":"600ea585-aa50-4596-9b14-090eab15f9a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":27759},{"type":"v1","addr":"172.21.15.50:6806","nonce":27759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":27759},{"type":"v1","addr":"172.21.15.50:6811","nonce":27759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":27759},{"type":"v1","addr":"172.21.15.50:6816","nonce":27759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":27759},{"type":"v1","addr":"172.21.15.50:6813","nonce":27759}]},"public_addr":"172.21.15.50:6806/27759","cluster_addr":"172.21.15.50:6811/27759","heartbeat_back_addr":"172.21.15.50:6816/27759","heartbeat_front_addr":"172.21.15.50:6813/27759","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-19T22:07:56.415731+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-19T22:07:56.346062+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-19T22:07:56.090889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-19T22:08:01.280 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.278+0000 7ff3e822b700 1 -- 172.21.15.50:0/2774520927 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7ff3c801fa80 msgr2=0x7ff3c8021f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:01.280 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.278+0000 7ff3e822b700 1 --2- 172.21.15.50:0/2774520927 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7ff3c801fa80 0x7ff3c8021f90 crc :-1 s=READY pgs=9 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:01.280 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.278+0000 7ff3e822b700 1 -- 172.21.15.50:0/2774520927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3e0089920 msgr2=0x7ff3e00630e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:01.280 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.278+0000 7ff3e822b700 1 --2- 172.21.15.50:0/2774520927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3e0089920 0x7ff3e00630e0 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7ff3dc008790 tx=0x7ff3dc011770).stop 2019-12-19T22:08:01.281 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.278+0000 7ff3e822b700 1 -- 172.21.15.50:0/2774520927 shutdown_connections 2019-12-19T22:08:01.282 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.278+0000 7ff3e822b700 1 --2- 172.21.15.50:0/2774520927 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7ff3c801fa80 0x7ff3c8021f90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:01.282 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.278+0000 7ff3e822b700 1 --2- 172.21.15.50:0/2774520927 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3e0089920 0x7ff3e00630e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:01.282 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.278+0000 7ff3e822b700 1 -- 172.21.15.50:0/2774520927 shutdown_connections 2019-12-19T22:08:01.282 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.278+0000 7ff3e822b700 1 -- 172.21.15.50:0/2774520927 wait complete. 2019-12-19T22:08:01.282 INFO:teuthology.misc.health.smithi050.stderr:2019-12-19T22:08:01.278+0000 7ff3e822b700 1 -- 172.21.15.50:0/2774520927 >> 172.21.15.50:0/2774520927 conn(0x7ff3e008fbf0 msgr2=0x7ff3e007b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:01.289 DEBUG:teuthology.misc:3 of 3 OSDs are up 2019-12-19T22:08:01.289 INFO:tasks.ceph:Creating RBD pool 2019-12-19T22:08:01.289 INFO:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd pool create rbd 8 2019-12-19T22:08:01.404 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.400+0000 7f49d691d700 1 Processor -- start 2019-12-19T22:08:01.404 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.400+0000 7f49d691d700 1 -- start start 2019-12-19T22:08:01.404 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.400+0000 7f49d691d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f49d008eb70 0x7f49d007e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:01.404 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.400+0000 7f49d691d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49d008fd30 con 0x7f49d007dac0 2019-12-19T22:08:01.405 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.400+0000 7f49d691d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49d0089d10 con 0x7f49d008eb70 2019-12-19T22:08:01.405 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.401+0000 7f49cffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f49d008eb70 0x7f49d007e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:01.405 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.401+0000 7f49d4eba700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f49d007dac0 0x7f49d0089510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39550/0 (socket says 172.21.15.50:39550) 2019-12-19T22:08:01.405 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.401+0000 7f49d4eba700 1 -- 172.21.15.50:0/1908750080 learned_addr learned my addr 172.21.15.50:0/1908750080 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:01.405 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.401+0000 7f49cffff700 1 -- 172.21.15.50:0/1908750080 >> v1:172.21.15.50:6789/0 conn(0x7f49d007dac0 legacy=0x7f49d0089510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:01.405 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.401+0000 7f49cffff700 1 -- 172.21.15.50:0/1908750080 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d008f8f0 con 0x7f49d008eb70 2019-12-19T22:08:01.406 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.401+0000 7f49cf7fe700 1 -- 172.21.15.50:0/1908750080 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1503378047 0 0) 0x7f49d008fd30 con 0x7f49d007dac0 2019-12-19T22:08:01.406 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.401+0000 7f49cffff700 1 --2- 172.21.15.50:0/1908750080 >> v2:172.21.15.50:3300/0 conn(0x7f49d008eb70 0x7f49d007e000 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f49c4008790 tx=0x7f49c400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:01.406 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.401+0000 7f49cffff700 1 --2- 172.21.15.50:0/1908750080 >> v2:172.21.15.50:3300/0 conn(0x7f49d008eb70 0x7f49d007e000 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f49c4008790 tx=0x7f49c400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:01.406 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.401+0000 7f49cffff700 1 --2- 172.21.15.50:0/1908750080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49d008eb70 0x7f49d007e000 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7f49c4008790 tx=0x7f49c400fbf0).ready entity=mon.0 client_cookie=213780f381088642 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:01.406 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.401+0000 7f49cffff700 1 --2- 172.21.15.50:0/1908750080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49d008eb70 0x7f49d007e000 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f49c4008790 tx=0x7f49c400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:01.407 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.401+0000 7f49cf7fe700 1 -- 172.21.15.50:0/1908750080 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f49c4011270 con 0x7f49d008eb70 2019-12-19T22:08:01.407 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.401+0000 7f49cffff700 1 --2- 172.21.15.50:0/1908750080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49d008eb70 0x7f49d007e000 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f49c4008790 tx=0x7f49c400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:01.407 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.401+0000 7f49cffff700 1 --2- 172.21.15.50:0/1908750080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49d008eb70 0x7f49d007e000 secure :-1 s=THROTTLE_DONE pgs=43 cs=0 l=1 rx=0x7f49c4008790 tx=0x7f49c400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:01.407 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.401+0000 7f49cf7fe700 1 -- 172.21.15.50:0/1908750080 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c4011470 con 0x7f49d008eb70 2019-12-19T22:08:01.407 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.401+0000 7f49cf7fe700 1 -- 172.21.15.50:0/1908750080 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f49c4011790 con 0x7f49d008eb70 2019-12-19T22:08:01.408 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.401+0000 7f49d691d700 1 -- 172.21.15.50:0/1908750080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49d008eb70 msgr2=0x7f49d007e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:01.408 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.401+0000 7f49d691d700 1 --2- 172.21.15.50:0/1908750080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49d008eb70 0x7f49d007e000 secure :-1 s=READY pgs=43 cs=0 l=1 rx=0x7f49c4008790 tx=0x7f49c400fbf0).stop 2019-12-19T22:08:01.408 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.402+0000 7f49d691d700 1 -- 172.21.15.50:0/1908750080 shutdown_connections 2019-12-19T22:08:01.408 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.402+0000 7f49d691d700 1 --2- 172.21.15.50:0/1908750080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49d008eb70 0x7f49d007e000 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:01.408 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.402+0000 7f49d691d700 1 -- 172.21.15.50:0/1908750080 shutdown_connections 2019-12-19T22:08:01.409 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.402+0000 7f49d691d700 1 -- 172.21.15.50:0/1908750080 wait complete. 2019-12-19T22:08:01.409 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.402+0000 7f49d691d700 1 -- 172.21.15.50:0/1908750080 >> 172.21.15.50:0/1908750080 conn(0x7f49d0092f20 msgr2=0x7f49d008b240 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:01.409 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.402+0000 7f49d691d700 1 Processor -- start 2019-12-19T22:08:01.409 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.403+0000 7f49d691d700 1 -- start start 2019-12-19T22:08:01.412 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.403+0000 7f49d691d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f49d0124cc0 0x7f49d0127100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:01.412 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.403+0000 7f49d691d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49d0082950 con 0x7f49d00908d0 2019-12-19T22:08:01.412 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.403+0000 7f49d691d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49d005fc50 con 0x7f49d0124cc0 2019-12-19T22:08:01.412 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.403+0000 7f49cffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f49d0124cc0 0x7f49d0127100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:01.413 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.403+0000 7f49cffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f49d0124cc0 0x7f49d0127100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53428/0 (socket says 172.21.15.50:53428) 2019-12-19T22:08:01.413 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.403+0000 7f49cffff700 1 -- 172.21.15.50:0/3553148098 learned_addr learned my addr 172.21.15.50:0/3553148098 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:01.413 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.403+0000 7f49cffff700 1 -- 172.21.15.50:0/3553148098 >> v1:172.21.15.50:6789/0 conn(0x7f49d00908d0 legacy=0x7f49d0090d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:01.413 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.403+0000 7f49cffff700 1 -- 172.21.15.50:0/3553148098 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d007b080 con 0x7f49d0124cc0 2019-12-19T22:08:01.413 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.404+0000 7f49cffff700 1 --2- 172.21.15.50:0/3553148098 >> v2:172.21.15.50:3300/0 conn(0x7f49d0124cc0 0x7f49d0127100 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f49d00616b0 tx=0x7f49c400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:01.413 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.404+0000 7f49cffff700 1 --2- 172.21.15.50:0/3553148098 >> v2:172.21.15.50:3300/0 conn(0x7f49d0124cc0 0x7f49d0127100 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f49d00616b0 tx=0x7f49c400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:01.413 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.404+0000 7f49cffff700 1 --2- 172.21.15.50:0/3553148098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49d0124cc0 0x7f49d0127100 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7f49d00616b0 tx=0x7f49c400f780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:01.414 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.404+0000 7f49cffff700 1 --2- 172.21.15.50:0/3553148098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49d0124cc0 0x7f49d0127100 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f49d00616b0 tx=0x7f49c400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:01.414 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.404+0000 7f49cffff700 1 --2- 172.21.15.50:0/3553148098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49d0124cc0 0x7f49d0127100 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f49d00616b0 tx=0x7f49c400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:01.414 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.404+0000 7f49cffff700 1 --2- 172.21.15.50:0/3553148098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49d0124cc0 0x7f49d0127100 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f49d00616b0 tx=0x7f49c400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:01.414 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.404+0000 7f49cd7fa700 1 -- 172.21.15.50:0/3553148098 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f49c4007280 con 0x7f49d0124cc0 2019-12-19T22:08:01.414 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.404+0000 7f49cd7fa700 1 -- 172.21.15.50:0/3553148098 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c4007480 con 0x7f49d0124cc0 2019-12-19T22:08:01.414 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.404+0000 7f49cd7fa700 1 -- 172.21.15.50:0/3553148098 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f49c40115b0 con 0x7f49d0124cc0 2019-12-19T22:08:01.414 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.404+0000 7f49d691d700 1 -- 172.21.15.50:0/3553148098 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49d0060450 con 0x7f49d0124cc0 2019-12-19T22:08:01.415 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.404+0000 7f49d691d700 1 -- 172.21.15.50:0/3553148098 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49d00916c0 con 0x7f49d0124cc0 2019-12-19T22:08:01.415 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.404+0000 7f49cffff700 1 --2- 172.21.15.50:0/3553148098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49d0124cc0 0x7f49d0127100 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f49d00616b0 tx=0x7f49c400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:01.415 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.404+0000 7f49cd7fa700 1 -- 172.21.15.50:0/3553148098 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7f49c4005540 con 0x7f49d0124cc0 2019-12-19T22:08:01.415 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.404+0000 7f49cffff700 1 --2- 172.21.15.50:0/3553148098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49d0124cc0 0x7f49d0127100 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f49d00616b0 tx=0x7f49c400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:01.415 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.404+0000 7f49cd7fa700 1 --2- 172.21.15.50:0/3553148098 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f49b001fab0 0x7f49b0021fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:01.415 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.404+0000 7f49cd7fa700 1 -- 172.21.15.50:0/3553148098 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 2230+0+0 (secure 0 0 0) 0x7f49c402ac10 con 0x7f49d0124cc0 2019-12-19T22:08:01.415 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.405+0000 7f49d4eba700 1 --2- 172.21.15.50:0/3553148098 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f49b001fab0 0x7f49b0021fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:01.416 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.405+0000 7f49d691d700 1 -- 172.21.15.50:0/3553148098 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49d00663a0 con 0x7f49d0124cc0 2019-12-19T22:08:01.416 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.405+0000 7f49d4eba700 1 --2- 172.21.15.50:0/3553148098 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f49b001fab0 0x7f49b0021fc0 crc :-1 s=READY pgs=10 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:01.416 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.408+0000 7f49cffff700 1 --2- 172.21.15.50:0/3553148098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49d0124cc0 0x7f49d0127100 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f49d00616b0 tx=0x7f49c400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:01.416 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.408+0000 7f49cd7fa700 1 -- 172.21.15.50:0/3553148098 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7f49d00916c0 con 0x7f49d0124cc0 2019-12-19T22:08:01.546 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:01.545+0000 7f49d691d700 1 -- 172.21.15.50:0/3553148098 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f49d0056340 con 0x7f49d0124cc0 2019-12-19T22:08:02.369 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.367+0000 7f49cffff700 1 --2- 172.21.15.50:0/3553148098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49d0124cc0 0x7f49d0127100 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7f49d00616b0 tx=0x7f49c400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:02.369 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.367+0000 7f49cd7fa700 1 -- 172.21.15.50:0/3553148098 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v11) v1 ==== 109+0+0 (secure 0 0 0) 0x7f49c4005d70 con 0x7f49d0124cc0 2019-12-19T22:08:02.373 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.371+0000 7f49d691d700 1 -- 172.21.15.50:0/3553148098 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f49b001fab0 msgr2=0x7f49b0021fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:02.373 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.371+0000 7f49d691d700 1 --2- 172.21.15.50:0/3553148098 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f49b001fab0 0x7f49b0021fc0 crc :-1 s=READY pgs=10 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:02.373 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.371+0000 7f49d691d700 1 -- 172.21.15.50:0/3553148098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49d0124cc0 msgr2=0x7f49d0127100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:02.374 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.371+0000 7f49d691d700 1 --2- 172.21.15.50:0/3553148098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49d0124cc0 0x7f49d0127100 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7f49d00616b0 tx=0x7f49c400f780).stop 2019-12-19T22:08:02.374 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.372+0000 7f49d691d700 1 -- 172.21.15.50:0/3553148098 shutdown_connections 2019-12-19T22:08:02.374 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.372+0000 7f49d691d700 1 --2- 172.21.15.50:0/3553148098 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f49b001fab0 0x7f49b0021fc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:02.374 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.372+0000 7f49d691d700 1 --2- 172.21.15.50:0/3553148098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49d0124cc0 0x7f49d0127100 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:02.375 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.372+0000 7f49d691d700 1 -- 172.21.15.50:0/3553148098 shutdown_connections 2019-12-19T22:08:02.375 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.372+0000 7f49d691d700 1 -- 172.21.15.50:0/3553148098 wait complete. 2019-12-19T22:08:02.375 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.372+0000 7f49d691d700 1 -- 172.21.15.50:0/3553148098 >> 172.21.15.50:0/3553148098 conn(0x7f49d00919e0 msgr2=0x7f49d0094480 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:02.375 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'rbd' created 2019-12-19T22:08:02.385 INFO:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2019-12-19T22:08:02.509 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.505+0000 7f77e5d0f700 1 Processor -- start 2019-12-19T22:08:02.509 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.505+0000 7f77e5d0f700 1 -- start start 2019-12-19T22:08:02.509 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.505+0000 7f77e5d0f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f77e0089940 0x7f77e0081880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:02.510 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.505+0000 7f77e5d0f700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77e008bd70 con 0x7f77e0089510 2019-12-19T22:08:02.510 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.505+0000 7f77e5d0f700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77e0065360 con 0x7f77e0089940 2019-12-19T22:08:02.510 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.506+0000 7f77df7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f77e0089940 0x7f77e0081880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:02.510 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.506+0000 7f77dffff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f77e0089510 0x7f77e0081080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39568/0 (socket says 172.21.15.50:39568) 2019-12-19T22:08:02.510 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.506+0000 7f77df7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f77e0089940 0x7f77e0081880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53440/0 (socket says 172.21.15.50:53440) 2019-12-19T22:08:02.510 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.506+0000 7f77dffff700 1 -- 172.21.15.50:0/2046631919 learned_addr learned my addr 172.21.15.50:0/2046631919 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:02.510 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.506+0000 7f77df7fe700 1 -- 172.21.15.50:0/2046631919 >> v1:172.21.15.50:6789/0 conn(0x7f77e0089510 legacy=0x7f77e0081080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:02.511 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.506+0000 7f77df7fe700 1 -- 172.21.15.50:0/2046631919 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e00663a0 con 0x7f77e0089940 2019-12-19T22:08:02.511 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.506+0000 7f77df7fe700 1 --2- 172.21.15.50:0/2046631919 >> v2:172.21.15.50:3300/0 conn(0x7f77e0089940 0x7f77e0081880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f77d4008790 tx=0x7f77d400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:02.511 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.506+0000 7f77df7fe700 1 --2- 172.21.15.50:0/2046631919 >> v2:172.21.15.50:3300/0 conn(0x7f77e0089940 0x7f77e0081880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f77d4008790 tx=0x7f77d400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:02.511 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.506+0000 7f77df7fe700 1 --2- 172.21.15.50:0/2046631919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77e0089940 0x7f77e0081880 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7f77d4008790 tx=0x7f77d400fbf0).ready entity=mon.0 client_cookie=45bba5762dea843c server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:02.511 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.506+0000 7f77df7fe700 1 --2- 172.21.15.50:0/2046631919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77e0089940 0x7f77e0081880 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f77d4008790 tx=0x7f77d400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:02.511 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.506+0000 7f77deffd700 1 -- 172.21.15.50:0/2046631919 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f77d4011270 con 0x7f77e0089940 2019-12-19T22:08:02.512 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.506+0000 7f77df7fe700 1 --2- 172.21.15.50:0/2046631919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77e0089940 0x7f77e0081880 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f77d4008790 tx=0x7f77d400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:02.512 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.506+0000 7f77deffd700 1 -- 172.21.15.50:0/2046631919 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d4011470 con 0x7f77e0089940 2019-12-19T22:08:02.512 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.506+0000 7f77df7fe700 1 --2- 172.21.15.50:0/2046631919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77e0089940 0x7f77e0081880 secure :-1 s=THROTTLE_DONE pgs=47 cs=0 l=1 rx=0x7f77d4008790 tx=0x7f77d400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:02.512 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.506+0000 7f77e5d0f700 1 -- 172.21.15.50:0/2046631919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77e0089940 msgr2=0x7f77e0081880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:02.512 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.506+0000 7f77deffd700 1 -- 172.21.15.50:0/2046631919 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f77d40117d0 con 0x7f77e0089940 2019-12-19T22:08:02.512 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.506+0000 7f77e5d0f700 1 --2- 172.21.15.50:0/2046631919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77e0089940 0x7f77e0081880 secure :-1 s=READY pgs=47 cs=0 l=1 rx=0x7f77d4008790 tx=0x7f77d400fbf0).stop 2019-12-19T22:08:02.512 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.507+0000 7f77e5d0f700 1 -- 172.21.15.50:0/2046631919 shutdown_connections 2019-12-19T22:08:02.513 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.507+0000 7f77e5d0f700 1 --2- 172.21.15.50:0/2046631919 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77e0089940 0x7f77e0081880 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:02.513 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.507+0000 7f77e5d0f700 1 -- 172.21.15.50:0/2046631919 shutdown_connections 2019-12-19T22:08:02.513 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.507+0000 7f77e5d0f700 1 -- 172.21.15.50:0/2046631919 wait complete. 2019-12-19T22:08:02.513 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.507+0000 7f77e5d0f700 1 -- 172.21.15.50:0/2046631919 >> 172.21.15.50:0/2046631919 conn(0x7f77e005f610 msgr2=0x7f77e0061a50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:02.513 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.507+0000 7f77e5d0f700 1 Processor -- start 2019-12-19T22:08:02.513 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.508+0000 7f77e5d0f700 1 -- start start 2019-12-19T22:08:02.517 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.508+0000 7f77e5d0f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f77e00829b0 0x7f77e0077450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:02.517 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.508+0000 7f77e5d0f700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77e0082290 con 0x7f77e00779a0 2019-12-19T22:08:02.517 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.508+0000 7f77e5d0f700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77e005ef90 con 0x7f77e00829b0 2019-12-19T22:08:02.517 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.508+0000 7f77dffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f77e00829b0 0x7f77e0077450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:02.517 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.508+0000 7f77dffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f77e00829b0 0x7f77e0077450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53444/0 (socket says 172.21.15.50:53444) 2019-12-19T22:08:02.518 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.508+0000 7f77dffff700 1 -- 172.21.15.50:0/2799928225 learned_addr learned my addr 172.21.15.50:0/2799928225 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:02.518 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.509+0000 7f77dffff700 1 -- 172.21.15.50:0/2799928225 >> v1:172.21.15.50:6789/0 conn(0x7f77e00779a0 legacy=0x7f77e007f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:02.518 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.509+0000 7f77dcff9700 1 -- 172.21.15.50:0/2799928225 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2294136234 0 0) 0x7f77e0082290 con 0x7f77e00779a0 2019-12-19T22:08:02.518 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.509+0000 7f77dffff700 1 -- 172.21.15.50:0/2799928225 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e0082530 con 0x7f77e00829b0 2019-12-19T22:08:02.518 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.509+0000 7f77dffff700 1 --2- 172.21.15.50:0/2799928225 >> v2:172.21.15.50:3300/0 conn(0x7f77e00829b0 0x7f77e0077450 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f77d0001440 tx=0x7f77d000c430).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:02.518 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.509+0000 7f77dffff700 1 --2- 172.21.15.50:0/2799928225 >> v2:172.21.15.50:3300/0 conn(0x7f77e00829b0 0x7f77e0077450 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f77d0001440 tx=0x7f77d000c430).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:02.519 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.509+0000 7f77dffff700 1 --2- 172.21.15.50:0/2799928225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77e00829b0 0x7f77e0077450 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7f77d0001440 tx=0x7f77d000c430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:02.519 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.509+0000 7f77dffff700 1 --2- 172.21.15.50:0/2799928225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77e00829b0 0x7f77e0077450 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f77d0001440 tx=0x7f77d000c430).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:02.519 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.509+0000 7f77dcff9700 1 -- 172.21.15.50:0/2799928225 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f77d00115e0 con 0x7f77e00829b0 2019-12-19T22:08:02.519 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.509+0000 7f77dffff700 1 --2- 172.21.15.50:0/2799928225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77e00829b0 0x7f77e0077450 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f77d0001440 tx=0x7f77d000c430).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:02.519 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.509+0000 7f77dffff700 1 --2- 172.21.15.50:0/2799928225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77e00829b0 0x7f77e0077450 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f77d0001440 tx=0x7f77d000c430).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:02.519 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.509+0000 7f77dcff9700 1 -- 172.21.15.50:0/2799928225 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d00117e0 con 0x7f77e00829b0 2019-12-19T22:08:02.520 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.509+0000 7f77e5d0f700 1 -- 172.21.15.50:0/2799928225 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77e0083890 con 0x7f77e00829b0 2019-12-19T22:08:02.520 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.509+0000 7f77dcff9700 1 -- 172.21.15.50:0/2799928225 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f77d0011b00 con 0x7f77e00829b0 2019-12-19T22:08:02.520 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.509+0000 7f77e5d0f700 1 -- 172.21.15.50:0/2799928225 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77e0077dd0 con 0x7f77e00829b0 2019-12-19T22:08:02.520 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.509+0000 7f77dffff700 1 --2- 172.21.15.50:0/2799928225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77e00829b0 0x7f77e0077450 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f77d0001440 tx=0x7f77d000c430).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:02.521 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.509+0000 7f77dcff9700 1 -- 172.21.15.50:0/2799928225 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7f77d0007180 con 0x7f77e00829b0 2019-12-19T22:08:02.521 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.509+0000 7f77dffff700 1 --2- 172.21.15.50:0/2799928225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77e00829b0 0x7f77e0077450 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f77d0001440 tx=0x7f77d000c430).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:02.521 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.510+0000 7f77dcff9700 1 --2- 172.21.15.50:0/2799928225 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f77c001f9a0 0x7f77c0021eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:02.521 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.510+0000 7f77dcff9700 1 -- 172.21.15.50:0/2799928225 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2572+0+0 (secure 0 0 0) 0x7f77d0029f00 con 0x7f77e00829b0 2019-12-19T22:08:02.521 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.510+0000 7f77df7fe700 1 --2- 172.21.15.50:0/2799928225 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f77c001f9a0 0x7f77c0021eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:02.522 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.510+0000 7f77df7fe700 1 --2- 172.21.15.50:0/2799928225 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f77c001f9a0 0x7f77c0021eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:02.522 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.510+0000 7f77e5d0f700 1 -- 172.21.15.50:0/2799928225 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77e0056340 con 0x7f77e00829b0 2019-12-19T22:08:02.522 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.513+0000 7f77dffff700 1 --2- 172.21.15.50:0/2799928225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77e00829b0 0x7f77e0077450 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f77d0001440 tx=0x7f77d000c430).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:02.522 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.513+0000 7f77dcff9700 1 -- 172.21.15.50:0/2799928225 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7f77e0082530 con 0x7f77e00829b0 2019-12-19T22:08:02.653 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:02.651+0000 7f77e5d0f700 1 -- 172.21.15.50:0/2799928225 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f77e0065560 con 0x7f77e00829b0 2019-12-19T22:08:03.371 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.370+0000 7f77dffff700 1 --2- 172.21.15.50:0/2799928225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77e00829b0 0x7f77e0077450 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7f77d0001440 tx=0x7f77d000c430).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:03.372 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.370+0000 7f77dcff9700 1 -- 172.21.15.50:0/2799928225 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v12) v1 ==== 173+0+0 (secure 0 0 0) 0x7f77d0011da0 con 0x7f77e00829b0 2019-12-19T22:08:03.375 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.374+0000 7f77e5d0f700 1 -- 172.21.15.50:0/2799928225 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f77c001f9a0 msgr2=0x7f77c0021eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:03.376 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.374+0000 7f77e5d0f700 1 --2- 172.21.15.50:0/2799928225 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f77c001f9a0 0x7f77c0021eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:03.376 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.374+0000 7f77e5d0f700 1 -- 172.21.15.50:0/2799928225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77e00829b0 msgr2=0x7f77e0077450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:03.376 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.374+0000 7f77e5d0f700 1 --2- 172.21.15.50:0/2799928225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77e00829b0 0x7f77e0077450 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7f77d0001440 tx=0x7f77d000c430).stop 2019-12-19T22:08:03.377 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.375+0000 7f77e5d0f700 1 -- 172.21.15.50:0/2799928225 shutdown_connections 2019-12-19T22:08:03.377 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.375+0000 7f77e5d0f700 1 --2- 172.21.15.50:0/2799928225 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f77c001f9a0 0x7f77c0021eb0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:03.378 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.375+0000 7f77e5d0f700 1 --2- 172.21.15.50:0/2799928225 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77e00829b0 0x7f77e0077450 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:03.378 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.375+0000 7f77e5d0f700 1 -- 172.21.15.50:0/2799928225 shutdown_connections 2019-12-19T22:08:03.378 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.375+0000 7f77e5d0f700 1 -- 172.21.15.50:0/2799928225 wait complete. 2019-12-19T22:08:03.378 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.375+0000 7f77e5d0f700 1 -- 172.21.15.50:0/2799928225 >> 172.21.15.50:0/2799928225 conn(0x7f77e007c200 msgr2=0x7f77e007dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:03.378 INFO:teuthology.orchestra.run.smithi050.stderr:enabled application 'rbd' on pool 'rbd' 2019-12-19T22:08:03.389 INFO:tasks.ceph:Setting up CephFS filesystem... 2019-12-19T22:08:03.389 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-12-19T22:08:03.512 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.508+0000 7f135628c700 1 Processor -- start 2019-12-19T22:08:03.512 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.508+0000 7f135628c700 1 -- start start 2019-12-19T22:08:03.512 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.508+0000 7f135628c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f13500898b0 0x7f1350081170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:03.512 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.508+0000 7f135628c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1350089ce0 con 0x7f1350089480 2019-12-19T22:08:03.513 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.508+0000 7f135628c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f135008ae60 con 0x7f13500898b0 2019-12-19T22:08:03.513 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.508+0000 7f1354829700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1350089480 0x7f135008f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39578/0 (socket says 172.21.15.50:39578) 2019-12-19T22:08:03.513 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.508+0000 7f134ffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f13500898b0 0x7f1350081170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:03.514 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.508+0000 7f1354829700 1 -- 172.21.15.50:0/492607538 learned_addr learned my addr 172.21.15.50:0/492607538 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:03.514 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.509+0000 7f134ffff700 1 -- 172.21.15.50:0/492607538 >> v1:172.21.15.50:6789/0 conn(0x7f1350089480 legacy=0x7f135008f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:03.514 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.509+0000 7f134ffff700 1 -- 172.21.15.50:0/492607538 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f135008edb0 con 0x7f13500898b0 2019-12-19T22:08:03.514 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.509+0000 7f134ffff700 1 --2- 172.21.15.50:0/492607538 >> v2:172.21.15.50:3300/0 conn(0x7f13500898b0 0x7f1350081170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1344008790 tx=0x7f134400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:03.514 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.509+0000 7f134ffff700 1 --2- 172.21.15.50:0/492607538 >> v2:172.21.15.50:3300/0 conn(0x7f13500898b0 0x7f1350081170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1344008790 tx=0x7f134400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:03.514 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.509+0000 7f134ffff700 1 --2- 172.21.15.50:0/492607538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13500898b0 0x7f1350081170 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7f1344008790 tx=0x7f134400fbf0).ready entity=mon.0 client_cookie=aee0dfdf9f95249 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:03.514 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.509+0000 7f134ffff700 1 --2- 172.21.15.50:0/492607538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13500898b0 0x7f1350081170 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f1344008790 tx=0x7f134400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:03.515 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.509+0000 7f134f7fe700 1 -- 172.21.15.50:0/492607538 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f1344011270 con 0x7f13500898b0 2019-12-19T22:08:03.515 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.509+0000 7f134ffff700 1 --2- 172.21.15.50:0/492607538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13500898b0 0x7f1350081170 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f1344008790 tx=0x7f134400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:03.515 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.509+0000 7f134ffff700 1 --2- 172.21.15.50:0/492607538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13500898b0 0x7f1350081170 secure :-1 s=THROTTLE_DONE pgs=51 cs=0 l=1 rx=0x7f1344008790 tx=0x7f134400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:03.515 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.509+0000 7f134f7fe700 1 -- 172.21.15.50:0/492607538 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1344011470 con 0x7f13500898b0 2019-12-19T22:08:03.515 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.509+0000 7f134f7fe700 1 -- 172.21.15.50:0/492607538 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f13440117d0 con 0x7f13500898b0 2019-12-19T22:08:03.515 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.509+0000 7f135628c700 1 -- 172.21.15.50:0/492607538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13500898b0 msgr2=0x7f1350081170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:03.515 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.509+0000 7f135628c700 1 --2- 172.21.15.50:0/492607538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13500898b0 0x7f1350081170 secure :-1 s=READY pgs=51 cs=0 l=1 rx=0x7f1344008790 tx=0x7f134400fbf0).stop 2019-12-19T22:08:03.516 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.510+0000 7f135628c700 1 -- 172.21.15.50:0/492607538 shutdown_connections 2019-12-19T22:08:03.516 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.510+0000 7f135628c700 1 --2- 172.21.15.50:0/492607538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13500898b0 0x7f1350081170 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:03.516 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.510+0000 7f135628c700 1 -- 172.21.15.50:0/492607538 shutdown_connections 2019-12-19T22:08:03.516 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.510+0000 7f135628c700 1 -- 172.21.15.50:0/492607538 wait complete. 2019-12-19T22:08:03.516 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.510+0000 7f135628c700 1 -- 172.21.15.50:0/492607538 >> 172.21.15.50:0/492607538 conn(0x7f1350067e70 msgr2=0x7f1350094570 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:03.516 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.511+0000 7f135628c700 1 Processor -- start 2019-12-19T22:08:03.516 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.511+0000 7f135628c700 1 -- start start 2019-12-19T22:08:03.521 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.511+0000 7f135628c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f13501219e0 0x7f1350123e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:03.521 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.511+0000 7f135628c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13500845c0 con 0x7f13500824d0 2019-12-19T22:08:03.521 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.511+0000 7f135628c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13500892b0 con 0x7f13501219e0 2019-12-19T22:08:03.521 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.511+0000 7f134ffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f13501219e0 0x7f1350123e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:03.522 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.511+0000 7f134ffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f13501219e0 0x7f1350123e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53456/0 (socket says 172.21.15.50:53456) 2019-12-19T22:08:03.522 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.511+0000 7f134ffff700 1 -- 172.21.15.50:0/3629094576 learned_addr learned my addr 172.21.15.50:0/3629094576 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:03.522 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.511+0000 7f134ffff700 1 -- 172.21.15.50:0/3629094576 >> v1:172.21.15.50:6789/0 conn(0x7f13500824d0 legacy=0x7f1350082900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:03.522 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.511+0000 7f134ffff700 1 -- 172.21.15.50:0/3629094576 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1350083db0 con 0x7f13501219e0 2019-12-19T22:08:03.522 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.511+0000 7f134ffff700 1 --2- 172.21.15.50:0/3629094576 >> v2:172.21.15.50:3300/0 conn(0x7f13501219e0 0x7f1350123e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1344008790 tx=0x7f134400f7b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:03.522 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.512+0000 7f134ffff700 1 --2- 172.21.15.50:0/3629094576 >> v2:172.21.15.50:3300/0 conn(0x7f13501219e0 0x7f1350123e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1344008790 tx=0x7f134400f7b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:03.522 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.512+0000 7f134ffff700 1 --2- 172.21.15.50:0/3629094576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13501219e0 0x7f1350123e20 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7f1344008790 tx=0x7f134400f7b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:03.523 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.512+0000 7f134ffff700 1 --2- 172.21.15.50:0/3629094576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13501219e0 0x7f1350123e20 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f1344008790 tx=0x7f134400f7b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:03.523 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.512+0000 7f134ffff700 1 --2- 172.21.15.50:0/3629094576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13501219e0 0x7f1350123e20 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f1344008790 tx=0x7f134400f7b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:03.523 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.512+0000 7f134ffff700 1 --2- 172.21.15.50:0/3629094576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13501219e0 0x7f1350123e20 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f1344008790 tx=0x7f134400f7b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:03.523 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.512+0000 7f134d7fa700 1 -- 172.21.15.50:0/3629094576 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f1344007280 con 0x7f13501219e0 2019-12-19T22:08:03.524 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.512+0000 7f134d7fa700 1 -- 172.21.15.50:0/3629094576 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1344011480 con 0x7f13501219e0 2019-12-19T22:08:03.524 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.512+0000 7f134d7fa700 1 -- 172.21.15.50:0/3629094576 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f13440117a0 con 0x7f13501219e0 2019-12-19T22:08:03.525 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.512+0000 7f135628c700 1 -- 172.21.15.50:0/3629094576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1350085d80 con 0x7f13501219e0 2019-12-19T22:08:03.525 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.512+0000 7f135628c700 1 -- 172.21.15.50:0/3629094576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1350085440 con 0x7f13501219e0 2019-12-19T22:08:03.525 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.512+0000 7f134ffff700 1 --2- 172.21.15.50:0/3629094576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13501219e0 0x7f1350123e20 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f1344008790 tx=0x7f134400f7b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:03.525 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.512+0000 7f134d7fa700 1 -- 172.21.15.50:0/3629094576 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7f1344005540 con 0x7f13501219e0 2019-12-19T22:08:03.525 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.512+0000 7f134ffff700 1 --2- 172.21.15.50:0/3629094576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13501219e0 0x7f1350123e20 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f1344008790 tx=0x7f134400f7b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:03.525 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.512+0000 7f134d7fa700 1 --2- 172.21.15.50:0/3629094576 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f133001fa80 0x7f1330021f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:03.525 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.512+0000 7f134d7fa700 1 -- 172.21.15.50:0/3629094576 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2583+0+0 (secure 0 0 0) 0x7f134402ad80 con 0x7f13501219e0 2019-12-19T22:08:03.526 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.513+0000 7f1354829700 1 --2- 172.21.15.50:0/3629094576 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f133001fa80 0x7f1330021f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:03.526 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.513+0000 7f1354829700 1 --2- 172.21.15.50:0/3629094576 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f133001fa80 0x7f1330021f90 crc :-1 s=READY pgs=12 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:03.526 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.513+0000 7f135628c700 1 -- 172.21.15.50:0/3629094576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1350056340 con 0x7f13501219e0 2019-12-19T22:08:03.526 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.516+0000 7f134ffff700 1 --2- 172.21.15.50:0/3629094576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13501219e0 0x7f1350123e20 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f1344008790 tx=0x7f134400f7b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:03.526 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.516+0000 7f134d7fa700 1 -- 172.21.15.50:0/3629094576 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7f134402a860 con 0x7f13501219e0 2019-12-19T22:08:03.656 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.654+0000 7f135628c700 1 -- 172.21.15.50:0/3629094576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1350086060 con 0x7f13501219e0 2019-12-19T22:08:03.657 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.655+0000 7f134ffff700 1 --2- 172.21.15.50:0/3629094576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13501219e0 0x7f1350123e20 secure :-1 s=THROTTLE_DONE pgs=53 cs=0 l=1 rx=0x7f1344008790 tx=0x7f134400f7b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:03.657 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.655+0000 7f134d7fa700 1 -- 172.21.15.50:0/3629094576 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+5957 (secure 0 0 0) 0x7f1344009bd0 con 0x7f13501219e0 2019-12-19T22:08:03.658 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:08:03.658 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":12,"fsid":"c1382993-41cc-4b35-a402-c17778701f01","created":"2019-12-19T22:07:52.345475+0000","modified":"2019-12-19T22:08:03.366784+0000","last_up_change":"2019-12-19T22:07:58.357117+0000","last_in_change":"2019-12-19T22:07:58.357117+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-19T22:08:01.570202+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"6137ed8c-8e2c-4e88-8634-dc763bed14c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":27757},{"type":"v1","addr":"172.21.15.50:6817","nonce":27757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":27757},{"type":"v1","addr":"172.21.15.50:6819","nonce":27757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":27757},{"type":"v1","addr":"172.21.15.50:6823","nonce":27757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":27757},{"type":"v1","addr":"172.21.15.50:6821","nonce":27757}]},"public_addr":"172.21.15.50:6817/27757","cluster_addr":"172.21.15.50:6819/27757","heartbeat_back_addr":"172.21.15.50:6823/27757","heartbeat_front_addr":"172.21.15.50:6821/27757","state":["exists","up"]},{"osd":1,"uuid":"57d4e31d-408e-4302-859d-7ea672b93772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":27758},{"type":"v1","addr":"172.21.15.50:6801","nonce":27758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":27758},{"type":"v1","addr":"172.21.15.50:6803","nonce":27758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":27758},{"type":"v1","addr":"172.21.15.50:6810","nonce":27758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6805","nonce":27758},{"type":"v1","addr":"172.21.15.50:6807","nonce":27758}]},"public_addr":"172.21.15.50:6801/27758","cluster_addr":"172.21.15.50:6803/27758","heartbeat_back_addr":"172.21.15.50:6810/27758","heartbeat_front_addr":"172.21.15.50:6807/27758","state":["exists","up"]},{"osd":2,"uuid":"600ea585-aa50-4596-9b14-090eab15f9a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":27759},{"type":"v1","addr":"172.21.15.50:6806","nonce":27759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":27759},{"type":"v1","addr":"172.21.15.50:6811","nonce":27759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":27759},{"type":"v1","addr":"172.21.15.50:6816","nonce":27759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":27759},{"type":"v1","addr":"172.21.15.50:6813","nonce":27759}]},"public_addr":"172.21.15.50:6806/27759","cluster_addr":"172.21.15.50:6811/27759","heartbeat_back_addr":"172.21.15.50:6816/27759","heartbeat_front_addr":"172.21.15.50:6813/27759","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-19T22:07:56.415731+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-19T22:07:56.346062+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-19T22:07:56.090889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-19T22:08:03.660 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.656+0000 7f135628c700 1 -- 172.21.15.50:0/3629094576 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f133001fa80 msgr2=0x7f1330021f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:03.660 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.656+0000 7f135628c700 1 --2- 172.21.15.50:0/3629094576 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f133001fa80 0x7f1330021f90 crc :-1 s=READY pgs=12 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:03.661 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.656+0000 7f135628c700 1 -- 172.21.15.50:0/3629094576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13501219e0 msgr2=0x7f1350123e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:03.661 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.656+0000 7f135628c700 1 --2- 172.21.15.50:0/3629094576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13501219e0 0x7f1350123e20 secure :-1 s=READY pgs=53 cs=0 l=1 rx=0x7f1344008790 tx=0x7f134400f7b0).stop 2019-12-19T22:08:03.661 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.656+0000 7f135628c700 1 -- 172.21.15.50:0/3629094576 shutdown_connections 2019-12-19T22:08:03.662 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.656+0000 7f135628c700 1 --2- 172.21.15.50:0/3629094576 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f133001fa80 0x7f1330021f90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:03.662 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.656+0000 7f135628c700 1 --2- 172.21.15.50:0/3629094576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13501219e0 0x7f1350123e20 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:03.662 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.656+0000 7f135628c700 1 -- 172.21.15.50:0/3629094576 shutdown_connections 2019-12-19T22:08:03.662 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.656+0000 7f135628c700 1 -- 172.21.15.50:0/3629094576 wait complete. 2019-12-19T22:08:03.663 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.656+0000 7f135628c700 1 -- 172.21.15.50:0/3629094576 >> 172.21.15.50:0/3629094576 conn(0x7f1350091150 msgr2=0x7f135007ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:03.672 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool,creating', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-19T22:08:01.570202+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 32769, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'12', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-12-19T22:08:03.673 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-12-19T22:08:03.796 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.786+0000 7fa757f87700 1 Processor -- start 2019-12-19T22:08:03.797 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.786+0000 7fa757f87700 1 -- start start 2019-12-19T22:08:03.797 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.787+0000 7fa757f87700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa75007dac0 0x7fa75008eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:03.797 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.787+0000 7fa757f87700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa75008fd30 con 0x7fa750089510 2019-12-19T22:08:03.798 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.787+0000 7fa757f87700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa75008f8f0 con 0x7fa75007dac0 2019-12-19T22:08:03.798 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.787+0000 7fa756524700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa75007dac0 0x7fa75008eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:03.798 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.787+0000 7fa756524700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa75007dac0 0x7fa75008eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53460/0 (socket says 172.21.15.50:53460) 2019-12-19T22:08:03.798 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.787+0000 7fa755d23700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa750089510 0x7fa75007e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39588/0 (socket says 172.21.15.50:39588) 2019-12-19T22:08:03.799 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.787+0000 7fa756524700 1 -- 172.21.15.50:0/1260489445 learned_addr learned my addr 172.21.15.50:0/1260489445 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:03.799 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.788+0000 7fa756524700 1 -- 172.21.15.50:0/1260489445 >> v1:172.21.15.50:6789/0 conn(0x7fa750089510 legacy=0x7fa75007e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:03.799 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.788+0000 7fa755522700 1 -- 172.21.15.50:0/1260489445 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 141694679 0 0) 0x7fa75008fd30 con 0x7fa750089510 2019-12-19T22:08:03.799 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.788+0000 7fa756524700 1 -- 172.21.15.50:0/1260489445 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa75008de50 con 0x7fa75007dac0 2019-12-19T22:08:03.799 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.788+0000 7fa756524700 1 --2- 172.21.15.50:0/1260489445 >> v2:172.21.15.50:3300/0 conn(0x7fa75007dac0 0x7fa75008eb70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa74c008790 tx=0x7fa74c00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:03.800 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.788+0000 7fa756524700 1 --2- 172.21.15.50:0/1260489445 >> v2:172.21.15.50:3300/0 conn(0x7fa75007dac0 0x7fa75008eb70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa74c008790 tx=0x7fa74c00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:03.800 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.788+0000 7fa756524700 1 --2- 172.21.15.50:0/1260489445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa75007dac0 0x7fa75008eb70 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7fa74c008790 tx=0x7fa74c00fcb0).ready entity=mon.0 client_cookie=eb4436b569ba746d server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:03.800 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.788+0000 7fa756524700 1 --2- 172.21.15.50:0/1260489445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa75007dac0 0x7fa75008eb70 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7fa74c008790 tx=0x7fa74c00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:03.800 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.788+0000 7fa755522700 1 -- 172.21.15.50:0/1260489445 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fa74c0112f0 con 0x7fa75007dac0 2019-12-19T22:08:03.801 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.788+0000 7fa756524700 1 --2- 172.21.15.50:0/1260489445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa75007dac0 0x7fa75008eb70 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7fa74c008790 tx=0x7fa74c00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:03.801 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.788+0000 7fa755522700 1 -- 172.21.15.50:0/1260489445 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74c0114f0 con 0x7fa75007dac0 2019-12-19T22:08:03.801 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.788+0000 7fa756524700 1 --2- 172.21.15.50:0/1260489445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa75007dac0 0x7fa75008eb70 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7fa74c008790 tx=0x7fa74c00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:03.801 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.788+0000 7fa755522700 1 -- 172.21.15.50:0/1260489445 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fa74c011810 con 0x7fa75007dac0 2019-12-19T22:08:03.802 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.788+0000 7fa757f87700 1 -- 172.21.15.50:0/1260489445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa75007dac0 msgr2=0x7fa75008eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:03.802 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.788+0000 7fa757f87700 1 --2- 172.21.15.50:0/1260489445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa75007dac0 0x7fa75008eb70 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7fa74c008790 tx=0x7fa74c00fcb0).stop 2019-12-19T22:08:03.802 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.788+0000 7fa757f87700 1 -- 172.21.15.50:0/1260489445 shutdown_connections 2019-12-19T22:08:03.802 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.788+0000 7fa757f87700 1 --2- 172.21.15.50:0/1260489445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa75007dac0 0x7fa75008eb70 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:03.803 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.788+0000 7fa757f87700 1 -- 172.21.15.50:0/1260489445 shutdown_connections 2019-12-19T22:08:03.803 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.788+0000 7fa757f87700 1 -- 172.21.15.50:0/1260489445 wait complete. 2019-12-19T22:08:03.803 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.788+0000 7fa757f87700 1 -- 172.21.15.50:0/1260489445 >> 172.21.15.50:0/1260489445 conn(0x7fa750092f20 msgr2=0x7fa75008b240 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:03.803 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.789+0000 7fa757f87700 1 Processor -- start 2019-12-19T22:08:03.803 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.789+0000 7fa757f87700 1 -- start start 2019-12-19T22:08:03.804 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.790+0000 7fa757f87700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa750089940 0x7fa750063360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:03.804 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.790+0000 7fa757f87700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa750065fa0 con 0x7fa750089510 2019-12-19T22:08:03.804 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.790+0000 7fa757f87700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa750091540 con 0x7fa750089940 2019-12-19T22:08:03.805 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.790+0000 7fa756524700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa750089510 0x7fa750062b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39590/0 (socket says 172.21.15.50:39590) 2019-12-19T22:08:03.805 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.790+0000 7fa756524700 1 -- 172.21.15.50:0/2031192366 learned_addr learned my addr 172.21.15.50:0/2031192366 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:03.805 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.790+0000 7fa755d23700 1 --2- 172.21.15.50:0/2031192366 >> v2:172.21.15.50:3300/0 conn(0x7fa750089940 0x7fa750063360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:03.805 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.790+0000 7fa746ffd700 1 -- 172.21.15.50:0/2031192366 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4065388723 0 0) 0x7fa750065fa0 con 0x7fa750089510 2019-12-19T22:08:03.806 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.790+0000 7fa746ffd700 1 -- 172.21.15.50:0/2031192366 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7380030b0 con 0x7fa750089510 2019-12-19T22:08:03.806 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.790+0000 7fa755d23700 1 -- 172.21.15.50:0/2031192366 >> v1:172.21.15.50:6789/0 conn(0x7fa750089510 legacy=0x7fa750062b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:03.806 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.790+0000 7fa755d23700 1 -- 172.21.15.50:0/2031192366 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7500657d0 con 0x7fa750089940 2019-12-19T22:08:03.806 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.790+0000 7fa755d23700 1 --2- 172.21.15.50:0/2031192366 >> v2:172.21.15.50:3300/0 conn(0x7fa750089940 0x7fa750063360 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa740000b80 tx=0x7fa7400107c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:03.807 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.790+0000 7fa755d23700 1 --2- 172.21.15.50:0/2031192366 >> v2:172.21.15.50:3300/0 conn(0x7fa750089940 0x7fa750063360 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa740000b80 tx=0x7fa7400107c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:03.807 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.790+0000 7fa755d23700 1 --2- 172.21.15.50:0/2031192366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa750089940 0x7fa750063360 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7fa740000b80 tx=0x7fa7400107c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:03.807 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.790+0000 7fa755d23700 1 --2- 172.21.15.50:0/2031192366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa750089940 0x7fa750063360 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7fa740000b80 tx=0x7fa7400107c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:03.807 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.790+0000 7fa746ffd700 1 -- 172.21.15.50:0/2031192366 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fa7400066d0 con 0x7fa750089940 2019-12-19T22:08:03.808 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.790+0000 7fa755d23700 1 --2- 172.21.15.50:0/2031192366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa750089940 0x7fa750063360 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7fa740000b80 tx=0x7fa7400107c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:03.808 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.790+0000 7fa757f87700 1 -- 172.21.15.50:0/2031192366 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa750065ae0 con 0x7fa750089940 2019-12-19T22:08:03.808 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.790+0000 7fa755d23700 1 --2- 172.21.15.50:0/2031192366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa750089940 0x7fa750063360 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7fa740000b80 tx=0x7fa7400107c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:03.808 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.790+0000 7fa746ffd700 1 -- 172.21.15.50:0/2031192366 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7400068d0 con 0x7fa750089940 2019-12-19T22:08:03.809 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.790+0000 7fa746ffd700 1 -- 172.21.15.50:0/2031192366 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fa740006bf0 con 0x7fa750089940 2019-12-19T22:08:03.809 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.790+0000 7fa757f87700 1 -- 172.21.15.50:0/2031192366 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa750066280 con 0x7fa750089940 2019-12-19T22:08:03.809 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.791+0000 7fa755d23700 1 --2- 172.21.15.50:0/2031192366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa750089940 0x7fa750063360 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7fa740000b80 tx=0x7fa7400107c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:03.811 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.791+0000 7fa746ffd700 1 -- 172.21.15.50:0/2031192366 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7fa740011200 con 0x7fa750089940 2019-12-19T22:08:03.812 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.791+0000 7fa755d23700 1 --2- 172.21.15.50:0/2031192366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa750089940 0x7fa750063360 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7fa740000b80 tx=0x7fa7400107c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:03.812 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.791+0000 7fa746ffd700 1 --2- 172.21.15.50:0/2031192366 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fa73801ffa0 0x7fa7380224b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:03.812 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.791+0000 7fa746ffd700 1 -- 172.21.15.50:0/2031192366 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2583+0+0 (secure 0 0 0) 0x7fa74002a310 con 0x7fa750089940 2019-12-19T22:08:03.812 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.791+0000 7fa756524700 1 --2- 172.21.15.50:0/2031192366 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fa73801ffa0 0x7fa7380224b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:03.813 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.791+0000 7fa756524700 1 --2- 172.21.15.50:0/2031192366 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fa73801ffa0 0x7fa7380224b0 crc :-1 s=READY pgs=13 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:03.813 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.792+0000 7fa757f87700 1 -- 172.21.15.50:0/2031192366 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7500910a0 con 0x7fa750089940 2019-12-19T22:08:03.814 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.795+0000 7fa755d23700 1 --2- 172.21.15.50:0/2031192366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa750089940 0x7fa750063360 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7fa740000b80 tx=0x7fa7400107c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:03.814 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.795+0000 7fa746ffd700 1 -- 172.21.15.50:0/2031192366 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7fa7400116a0 con 0x7fa750089940 2019-12-19T22:08:03.942 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.934+0000 7fa757f87700 1 -- 172.21.15.50:0/2031192366 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa750056340 con 0x7fa750089940 2019-12-19T22:08:03.942 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.934+0000 7fa755d23700 1 --2- 172.21.15.50:0/2031192366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa750089940 0x7fa750063360 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7fa740000b80 tx=0x7fa7400107c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:03.942 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.934+0000 7fa746ffd700 1 -- 172.21.15.50:0/2031192366 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v12) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa7400053c0 con 0x7fa750089940 2019-12-19T22:08:03.942 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.936+0000 7fa757f87700 1 -- 172.21.15.50:0/2031192366 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fa73801ffa0 msgr2=0x7fa7380224b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:03.942 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.936+0000 7fa757f87700 1 --2- 172.21.15.50:0/2031192366 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fa73801ffa0 0x7fa7380224b0 crc :-1 s=READY pgs=13 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:03.943 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.936+0000 7fa757f87700 1 -- 172.21.15.50:0/2031192366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa750089940 msgr2=0x7fa750063360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:03.943 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.936+0000 7fa757f87700 1 --2- 172.21.15.50:0/2031192366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa750089940 0x7fa750063360 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7fa740000b80 tx=0x7fa7400107c0).stop 2019-12-19T22:08:03.943 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.936+0000 7fa757f87700 1 -- 172.21.15.50:0/2031192366 shutdown_connections 2019-12-19T22:08:03.943 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.936+0000 7fa757f87700 1 --2- 172.21.15.50:0/2031192366 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fa73801ffa0 0x7fa7380224b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:03.943 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.936+0000 7fa757f87700 1 --2- 172.21.15.50:0/2031192366 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa750089940 0x7fa750063360 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:03.943 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.936+0000 7fa757f87700 1 -- 172.21.15.50:0/2031192366 shutdown_connections 2019-12-19T22:08:03.943 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.936+0000 7fa757f87700 1 -- 172.21.15.50:0/2031192366 wait complete. 2019-12-19T22:08:03.944 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:03.936+0000 7fa757f87700 1 -- 172.21.15.50:0/2031192366 >> 172.21.15.50:0/2031192366 conn(0x7fa75008d6e0 msgr2=0x7fa750092f20 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:03.944 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2019-12-19T22:08:03.957 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2019-12-19T22:08:04.075 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.070+0000 7ff31ef36700 1 Processor -- start 2019-12-19T22:08:04.076 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.070+0000 7ff31ef36700 1 -- start start 2019-12-19T22:08:04.076 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.071+0000 7ff31ef36700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff318089480 0x7ff3180898b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:04.076 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.071+0000 7ff31ef36700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff31808edb0 con 0x7ff31808f3d0 2019-12-19T22:08:04.076 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.071+0000 7ff31ef36700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff31808ae60 con 0x7ff318089480 2019-12-19T22:08:04.076 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.071+0000 7ff31d4d3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff318089480 0x7ff3180898b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:04.076 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.071+0000 7ff31d4d3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff318089480 0x7ff3180898b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53468/0 (socket says 172.21.15.50:53468) 2019-12-19T22:08:04.077 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.071+0000 7ff31d4d3700 1 -- 172.21.15.50:0/3962767514 learned_addr learned my addr 172.21.15.50:0/3962767514 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:04.077 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.071+0000 7ff31ccd2700 1 --1- 172.21.15.50:0/3962767514 >> v1:172.21.15.50:6789/0 conn(0x7ff31808f3d0 0x7ff318081170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39596/0 (socket says 172.21.15.50:39596) 2019-12-19T22:08:04.077 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.071+0000 7ff31d4d3700 1 -- 172.21.15.50:0/3962767514 >> v1:172.21.15.50:6789/0 conn(0x7ff31808f3d0 legacy=0x7ff318081170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:04.077 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.071+0000 7ff31d4d3700 1 -- 172.21.15.50:0/3962767514 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff318081970 con 0x7ff318089480 2019-12-19T22:08:04.077 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.071+0000 7ff31d4d3700 1 --2- 172.21.15.50:0/3962767514 >> v2:172.21.15.50:3300/0 conn(0x7ff318089480 0x7ff3180898b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff314008b10 tx=0x7ff314010030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:04.077 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.071+0000 7ff31d4d3700 1 --2- 172.21.15.50:0/3962767514 >> v2:172.21.15.50:3300/0 conn(0x7ff318089480 0x7ff3180898b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff314008b10 tx=0x7ff314010030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:04.077 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.072+0000 7ff31d4d3700 1 --2- 172.21.15.50:0/3962767514 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff318089480 0x7ff3180898b0 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7ff314008b10 tx=0x7ff314010030).ready entity=mon.0 client_cookie=37ad5e6d4f701090 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:04.078 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.072+0000 7ff31d4d3700 1 --2- 172.21.15.50:0/3962767514 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff318089480 0x7ff3180898b0 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7ff314008b10 tx=0x7ff314010030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:04.078 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.072+0000 7ff31d4d3700 1 --2- 172.21.15.50:0/3962767514 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff318089480 0x7ff3180898b0 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7ff314008b10 tx=0x7ff314010030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:04.078 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.072+0000 7ff30ffff700 1 -- 172.21.15.50:0/3962767514 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7ff314011d00 con 0x7ff318089480 2019-12-19T22:08:04.078 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.072+0000 7ff31d4d3700 1 --2- 172.21.15.50:0/3962767514 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff318089480 0x7ff3180898b0 secure :-1 s=THROTTLE_DONE pgs=59 cs=0 l=1 rx=0x7ff314008b10 tx=0x7ff314010030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:04.078 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.072+0000 7ff30ffff700 1 -- 172.21.15.50:0/3962767514 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff31400a160 con 0x7ff318089480 2019-12-19T22:08:04.078 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.072+0000 7ff30ffff700 1 -- 172.21.15.50:0/3962767514 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7ff31400a480 con 0x7ff318089480 2019-12-19T22:08:04.078 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.072+0000 7ff31ef36700 1 -- 172.21.15.50:0/3962767514 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff318089480 msgr2=0x7ff3180898b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:04.079 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.072+0000 7ff31ef36700 1 --2- 172.21.15.50:0/3962767514 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff318089480 0x7ff3180898b0 secure :-1 s=READY pgs=59 cs=0 l=1 rx=0x7ff314008b10 tx=0x7ff314010030).stop 2019-12-19T22:08:04.079 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.072+0000 7ff31ef36700 1 -- 172.21.15.50:0/3962767514 shutdown_connections 2019-12-19T22:08:04.079 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.072+0000 7ff31ef36700 1 --2- 172.21.15.50:0/3962767514 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff318089480 0x7ff3180898b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:04.079 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.072+0000 7ff31ef36700 1 -- 172.21.15.50:0/3962767514 shutdown_connections 2019-12-19T22:08:04.079 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.072+0000 7ff31ef36700 1 -- 172.21.15.50:0/3962767514 wait complete. 2019-12-19T22:08:04.079 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.072+0000 7ff31ef36700 1 -- 172.21.15.50:0/3962767514 >> 172.21.15.50:0/3962767514 conn(0x7ff318067e70 msgr2=0x7ff318094570 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:04.079 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.073+0000 7ff31ef36700 1 Processor -- start 2019-12-19T22:08:04.080 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.073+0000 7ff31ef36700 1 -- start start 2019-12-19T22:08:04.102 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.074+0000 7ff31ef36700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff31811f6d0 0x7ff31811fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:04.102 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.074+0000 7ff31ef36700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff318120480 con 0x7ff318120050 2019-12-19T22:08:04.103 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.074+0000 7ff31ef36700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3180912f0 con 0x7ff31811f6d0 2019-12-19T22:08:04.103 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.074+0000 7ff31d4d3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff31811f6d0 0x7ff31811fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:04.103 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.074+0000 7ff31d4d3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff31811f6d0 0x7ff31811fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53472/0 (socket says 172.21.15.50:53472) 2019-12-19T22:08:04.103 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.074+0000 7ff31ccd2700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff318120050 0x7ff318061820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39602/0 (socket says 172.21.15.50:39602) 2019-12-19T22:08:04.103 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.074+0000 7ff31d4d3700 1 -- 172.21.15.50:0/2003956318 learned_addr learned my addr 172.21.15.50:0/2003956318 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:04.103 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.074+0000 7ff31d4d3700 1 -- 172.21.15.50:0/2003956318 >> v1:172.21.15.50:6789/0 conn(0x7ff318120050 legacy=0x7ff318061820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:04.103 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.074+0000 7ff31d4d3700 1 -- 172.21.15.50:0/2003956318 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff318064690 con 0x7ff31811f6d0 2019-12-19T22:08:04.104 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.074+0000 7ff30dffb700 1 -- 172.21.15.50:0/2003956318 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4041730619 0 0) 0x7ff318120480 con 0x7ff318120050 2019-12-19T22:08:04.104 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.074+0000 7ff31d4d3700 1 --2- 172.21.15.50:0/2003956318 >> v2:172.21.15.50:3300/0 conn(0x7ff31811f6d0 0x7ff31811fb00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff314008b10 tx=0x7ff31400a9c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:04.104 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.074+0000 7ff31d4d3700 1 --2- 172.21.15.50:0/2003956318 >> v2:172.21.15.50:3300/0 conn(0x7ff31811f6d0 0x7ff31811fb00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff314008b10 tx=0x7ff31400a9c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:04.104 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.074+0000 7ff31d4d3700 1 --2- 172.21.15.50:0/2003956318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff31811f6d0 0x7ff31811fb00 secure :-1 s=READY pgs=61 cs=0 l=1 rx=0x7ff314008b10 tx=0x7ff31400a9c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:04.109 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.074+0000 7ff31d4d3700 1 --2- 172.21.15.50:0/2003956318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff31811f6d0 0x7ff31811fb00 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7ff314008b10 tx=0x7ff31400a9c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:04.109 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.074+0000 7ff30dffb700 1 -- 172.21.15.50:0/2003956318 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7ff3140058c0 con 0x7ff31811f6d0 2019-12-19T22:08:04.109 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.074+0000 7ff31d4d3700 1 --2- 172.21.15.50:0/2003956318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff31811f6d0 0x7ff31811fb00 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7ff314008b10 tx=0x7ff31400a9c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:04.109 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.074+0000 7ff31d4d3700 1 --2- 172.21.15.50:0/2003956318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff31811f6d0 0x7ff31811fb00 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7ff314008b10 tx=0x7ff31400a9c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:04.109 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.074+0000 7ff30dffb700 1 -- 172.21.15.50:0/2003956318 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff314005ac0 con 0x7ff31811f6d0 2019-12-19T22:08:04.109 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.074+0000 7ff30dffb700 1 -- 172.21.15.50:0/2003956318 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7ff314005de0 con 0x7ff31811f6d0 2019-12-19T22:08:04.110 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.074+0000 7ff31ef36700 1 -- 172.21.15.50:0/2003956318 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff318062c30 con 0x7ff31811f6d0 2019-12-19T22:08:04.110 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.074+0000 7ff31ef36700 1 -- 172.21.15.50:0/2003956318 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff318062f80 con 0x7ff31811f6d0 2019-12-19T22:08:04.110 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.075+0000 7ff31d4d3700 1 --2- 172.21.15.50:0/2003956318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff31811f6d0 0x7ff31811fb00 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7ff314008b10 tx=0x7ff31400a9c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:04.110 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.075+0000 7ff30dffb700 1 -- 172.21.15.50:0/2003956318 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7ff314007150 con 0x7ff31811f6d0 2019-12-19T22:08:04.112 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.075+0000 7ff31d4d3700 1 --2- 172.21.15.50:0/2003956318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff31811f6d0 0x7ff31811fb00 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7ff314008b10 tx=0x7ff31400a9c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:04.112 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.075+0000 7ff30dffb700 1 --2- 172.21.15.50:0/2003956318 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7ff2f801f9a0 0x7ff2f8021eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:04.113 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.075+0000 7ff30dffb700 1 -- 172.21.15.50:0/2003956318 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2583+0+0 (secure 0 0 0) 0x7ff31402b230 con 0x7ff31811f6d0 2019-12-19T22:08:04.113 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.075+0000 7ff31ccd2700 1 --2- 172.21.15.50:0/2003956318 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7ff2f801f9a0 0x7ff2f8021eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:04.113 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.075+0000 7ff31ef36700 1 -- 172.21.15.50:0/2003956318 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff318056340 con 0x7ff31811f6d0 2019-12-19T22:08:04.113 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.075+0000 7ff31ccd2700 1 --2- 172.21.15.50:0/2003956318 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7ff2f801f9a0 0x7ff2f8021eb0 crc :-1 s=READY pgs=14 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:04.115 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.079+0000 7ff31d4d3700 1 --2- 172.21.15.50:0/2003956318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff31811f6d0 0x7ff31811fb00 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7ff314008b10 tx=0x7ff31400a9c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:04.115 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.079+0000 7ff30dffb700 1 -- 172.21.15.50:0/2003956318 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7ff314006d70 con 0x7ff31811f6d0 2019-12-19T22:08:04.219 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.216+0000 7ff31ef36700 1 -- 172.21.15.50:0/2003956318 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff31808dcf0 con 0x7ff31811f6d0 2019-12-19T22:08:04.219 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.217+0000 7ff31d4d3700 1 --2- 172.21.15.50:0/2003956318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff31811f6d0 0x7ff31811fb00 secure :-1 s=THROTTLE_DONE pgs=61 cs=0 l=1 rx=0x7ff314008b10 tx=0x7ff31400a9c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:04.219 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.217+0000 7ff30dffb700 1 -- 172.21.15.50:0/2003956318 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v12) v1 ==== 84+0+64 (secure 0 0 0) 0x7ff31400f360 con 0x7ff31811f6d0 2019-12-19T22:08:04.220 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:08:04.220 INFO:teuthology.orchestra.run.smithi050.stdout:[ 2019-12-19T22:08:04.220 INFO:teuthology.orchestra.run.smithi050.stdout: { 2019-12-19T22:08:04.220 INFO:teuthology.orchestra.run.smithi050.stdout: "poolnum": 1, 2019-12-19T22:08:04.220 INFO:teuthology.orchestra.run.smithi050.stdout: "poolname": "rbd" 2019-12-19T22:08:04.220 INFO:teuthology.orchestra.run.smithi050.stdout: } 2019-12-19T22:08:04.221 INFO:teuthology.orchestra.run.smithi050.stdout:] 2019-12-19T22:08:04.222 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.218+0000 7ff31ef36700 1 -- 172.21.15.50:0/2003956318 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7ff2f801f9a0 msgr2=0x7ff2f8021eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:04.222 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.218+0000 7ff31ef36700 1 --2- 172.21.15.50:0/2003956318 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7ff2f801f9a0 0x7ff2f8021eb0 crc :-1 s=READY pgs=14 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:04.222 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.218+0000 7ff31ef36700 1 -- 172.21.15.50:0/2003956318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff31811f6d0 msgr2=0x7ff31811fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:04.222 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.218+0000 7ff31ef36700 1 --2- 172.21.15.50:0/2003956318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff31811f6d0 0x7ff31811fb00 secure :-1 s=READY pgs=61 cs=0 l=1 rx=0x7ff314008b10 tx=0x7ff31400a9c0).stop 2019-12-19T22:08:04.222 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.218+0000 7ff31ef36700 1 -- 172.21.15.50:0/2003956318 shutdown_connections 2019-12-19T22:08:04.222 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.218+0000 7ff31ef36700 1 --2- 172.21.15.50:0/2003956318 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7ff2f801f9a0 0x7ff2f8021eb0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:04.222 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.218+0000 7ff31ef36700 1 --2- 172.21.15.50:0/2003956318 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff31811f6d0 0x7ff31811fb00 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:04.223 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.218+0000 7ff31ef36700 1 -- 172.21.15.50:0/2003956318 shutdown_connections 2019-12-19T22:08:04.223 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.218+0000 7ff31ef36700 1 -- 172.21.15.50:0/2003956318 wait complete. 2019-12-19T22:08:04.223 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.218+0000 7ff31ef36700 1 -- 172.21.15.50:0/2003956318 >> 172.21.15.50:0/2003956318 conn(0x7ff318081c40 msgr2=0x7ff31808bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:04.230 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2019-12-19T22:08:04.231 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2019-12-19T22:08:04.352 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.344+0000 7f4dd9227700 1 Processor -- start 2019-12-19T22:08:04.352 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.344+0000 7f4dd9227700 1 -- start start 2019-12-19T22:08:04.352 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.344+0000 7f4dd9227700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4dd407dac0 0x7f4dd408eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:04.353 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.344+0000 7f4dd9227700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dd408fd30 con 0x7f4dd4089510 2019-12-19T22:08:04.353 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.344+0000 7f4dd9227700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dd408f8f0 con 0x7f4dd407dac0 2019-12-19T22:08:04.353 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.345+0000 7f4dd359e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4dd407dac0 0x7f4dd408eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:04.353 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.345+0000 7f4dd359e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4dd407dac0 0x7f4dd408eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53478/0 (socket says 172.21.15.50:53478) 2019-12-19T22:08:04.353 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.345+0000 7f4dd359e700 1 -- 172.21.15.50:0/865764814 learned_addr learned my addr 172.21.15.50:0/865764814 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:04.353 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.345+0000 7f4dd2d9d700 1 --1- 172.21.15.50:0/865764814 >> v1:172.21.15.50:6789/0 conn(0x7f4dd4089510 0x7f4dd407e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39606/0 (socket says 172.21.15.50:39606) 2019-12-19T22:08:04.354 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.345+0000 7f4dd359e700 1 -- 172.21.15.50:0/865764814 >> v1:172.21.15.50:6789/0 conn(0x7f4dd4089510 legacy=0x7f4dd407e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:04.354 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.345+0000 7f4dd359e700 1 -- 172.21.15.50:0/865764814 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd408de50 con 0x7f4dd407dac0 2019-12-19T22:08:04.354 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.345+0000 7f4dd359e700 1 --2- 172.21.15.50:0/865764814 >> v2:172.21.15.50:3300/0 conn(0x7f4dd407dac0 0x7f4dd408eb70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4dc4008790 tx=0x7f4dc400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:04.354 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.345+0000 7f4dd359e700 1 --2- 172.21.15.50:0/865764814 >> v2:172.21.15.50:3300/0 conn(0x7f4dd407dac0 0x7f4dd408eb70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4dc4008790 tx=0x7f4dc400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:04.355 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.345+0000 7f4dd359e700 1 --2- 172.21.15.50:0/865764814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dd407dac0 0x7f4dd408eb70 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7f4dc4008790 tx=0x7f4dc400fcb0).ready entity=mon.0 client_cookie=ceff96f0a023602 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:04.355 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.345+0000 7f4dd359e700 1 --2- 172.21.15.50:0/865764814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dd407dac0 0x7f4dd408eb70 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f4dc4008790 tx=0x7f4dc400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:04.355 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.345+0000 7f4dd259c700 1 -- 172.21.15.50:0/865764814 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f4dc40112f0 con 0x7f4dd407dac0 2019-12-19T22:08:04.355 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.345+0000 7f4dd359e700 1 --2- 172.21.15.50:0/865764814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dd407dac0 0x7f4dd408eb70 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f4dc4008790 tx=0x7f4dc400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:04.355 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.345+0000 7f4dd259c700 1 -- 172.21.15.50:0/865764814 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc40114f0 con 0x7f4dd407dac0 2019-12-19T22:08:04.355 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.345+0000 7f4dd359e700 1 --2- 172.21.15.50:0/865764814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dd407dac0 0x7f4dd408eb70 secure :-1 s=THROTTLE_DONE pgs=63 cs=0 l=1 rx=0x7f4dc4008790 tx=0x7f4dc400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:04.356 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.345+0000 7f4dd259c700 1 -- 172.21.15.50:0/865764814 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f4dc4011810 con 0x7f4dd407dac0 2019-12-19T22:08:04.356 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.345+0000 7f4dd9227700 1 -- 172.21.15.50:0/865764814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dd407dac0 msgr2=0x7f4dd408eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:04.356 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.345+0000 7f4dd9227700 1 --2- 172.21.15.50:0/865764814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dd407dac0 0x7f4dd408eb70 secure :-1 s=READY pgs=63 cs=0 l=1 rx=0x7f4dc4008790 tx=0x7f4dc400fcb0).stop 2019-12-19T22:08:04.356 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.346+0000 7f4dd9227700 1 -- 172.21.15.50:0/865764814 shutdown_connections 2019-12-19T22:08:04.356 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.346+0000 7f4dd9227700 1 --2- 172.21.15.50:0/865764814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dd407dac0 0x7f4dd408eb70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:04.356 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.346+0000 7f4dd9227700 1 -- 172.21.15.50:0/865764814 shutdown_connections 2019-12-19T22:08:04.356 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.346+0000 7f4dd9227700 1 -- 172.21.15.50:0/865764814 wait complete. 2019-12-19T22:08:04.357 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.346+0000 7f4dd9227700 1 -- 172.21.15.50:0/865764814 >> 172.21.15.50:0/865764814 conn(0x7f4dd4092f20 msgr2=0x7f4dd408b240 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:04.357 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.347+0000 7f4dd9227700 1 Processor -- start 2019-12-19T22:08:04.357 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.347+0000 7f4dd9227700 1 -- start start 2019-12-19T22:08:04.357 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.347+0000 7f4dd9227700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4dd4062610 0x7f4dd405fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:04.357 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.347+0000 7f4dd9227700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dd4061cb0 con 0x7f4dd4060020 2019-12-19T22:08:04.357 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.347+0000 7f4dd9227700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dd40614f0 con 0x7f4dd4062610 2019-12-19T22:08:04.357 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.347+0000 7f4dd359e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4dd4062610 0x7f4dd405fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:04.358 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.347+0000 7f4dd359e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4dd4062610 0x7f4dd405fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53482/0 (socket says 172.21.15.50:53482) 2019-12-19T22:08:04.358 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.347+0000 7f4dd359e700 1 -- 172.21.15.50:0/965436512 learned_addr learned my addr 172.21.15.50:0/965436512 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:04.358 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.348+0000 7f4dd359e700 1 -- 172.21.15.50:0/965436512 >> v1:172.21.15.50:6789/0 conn(0x7f4dd4060020 legacy=0x7f4dd4079fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:04.358 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.348+0000 7f4dbbfff700 1 -- 172.21.15.50:0/965436512 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1212736404 0 0) 0x7f4dd4061cb0 con 0x7f4dd4060020 2019-12-19T22:08:04.358 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.348+0000 7f4dd359e700 1 -- 172.21.15.50:0/965436512 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd407ecd0 con 0x7f4dd4062610 2019-12-19T22:08:04.358 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.348+0000 7f4dd359e700 1 --2- 172.21.15.50:0/965436512 >> v2:172.21.15.50:3300/0 conn(0x7f4dd4062610 0x7f4dd405fad0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4dc4008790 tx=0x7f4dc40112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:04.358 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.348+0000 7f4dd359e700 1 --2- 172.21.15.50:0/965436512 >> v2:172.21.15.50:3300/0 conn(0x7f4dd4062610 0x7f4dd405fad0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4dc4008790 tx=0x7f4dc40112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:04.359 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.348+0000 7f4dd359e700 1 --2- 172.21.15.50:0/965436512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dd4062610 0x7f4dd405fad0 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7f4dc4008790 tx=0x7f4dc40112f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:04.359 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.348+0000 7f4dd359e700 1 --2- 172.21.15.50:0/965436512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dd4062610 0x7f4dd405fad0 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f4dc4008790 tx=0x7f4dc40112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:04.359 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.348+0000 7f4dbbfff700 1 -- 172.21.15.50:0/965436512 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f4dc400f160 con 0x7f4dd4062610 2019-12-19T22:08:04.359 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.348+0000 7f4dd359e700 1 --2- 172.21.15.50:0/965436512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dd4062610 0x7f4dd405fad0 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f4dc4008790 tx=0x7f4dc40112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:04.359 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.348+0000 7f4dbbfff700 1 -- 172.21.15.50:0/965436512 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc4005540 con 0x7f4dd4062610 2019-12-19T22:08:04.359 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.348+0000 7f4dd359e700 1 --2- 172.21.15.50:0/965436512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dd4062610 0x7f4dd405fad0 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f4dc4008790 tx=0x7f4dc40112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:04.359 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.348+0000 7f4dd9227700 1 -- 172.21.15.50:0/965436512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dd4061fd0 con 0x7f4dd4062610 2019-12-19T22:08:04.360 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.348+0000 7f4dbbfff700 1 -- 172.21.15.50:0/965436512 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f4dc4005860 con 0x7f4dd4062610 2019-12-19T22:08:04.360 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.348+0000 7f4dd9227700 1 -- 172.21.15.50:0/965436512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dd4063470 con 0x7f4dd4062610 2019-12-19T22:08:04.360 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.348+0000 7f4dd359e700 1 --2- 172.21.15.50:0/965436512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dd4062610 0x7f4dd405fad0 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f4dc4008790 tx=0x7f4dc40112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:04.360 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.348+0000 7f4dbbfff700 1 -- 172.21.15.50:0/965436512 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7f4dc4007180 con 0x7f4dd4062610 2019-12-19T22:08:04.360 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.348+0000 7f4dd359e700 1 --2- 172.21.15.50:0/965436512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dd4062610 0x7f4dd405fad0 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f4dc4008790 tx=0x7f4dc40112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:04.360 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.349+0000 7f4dbbfff700 1 --2- 172.21.15.50:0/965436512 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f4db401f960 0x7f4db4021e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:04.361 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.349+0000 7f4dbbfff700 1 -- 172.21.15.50:0/965436512 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2583+0+0 (secure 0 0 0) 0x7f4dc402cf70 con 0x7f4dd4062610 2019-12-19T22:08:04.361 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.349+0000 7f4dd2d9d700 1 --2- 172.21.15.50:0/965436512 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f4db401f960 0x7f4db4021e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:04.361 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.349+0000 7f4dd9227700 1 -- 172.21.15.50:0/965436512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dd4062cf0 con 0x7f4dd4062610 2019-12-19T22:08:04.361 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.349+0000 7f4dd2d9d700 1 --2- 172.21.15.50:0/965436512 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f4db401f960 0x7f4db4021e70 crc :-1 s=READY pgs=15 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:04.362 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.352+0000 7f4dd359e700 1 --2- 172.21.15.50:0/965436512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dd4062610 0x7f4dd405fad0 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f4dc4008790 tx=0x7f4dc40112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:04.362 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.352+0000 7f4dbbfff700 1 -- 172.21.15.50:0/965436512 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7f4dc400d450 con 0x7f4dd4062610 2019-12-19T22:08:04.492 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:04.489+0000 7f4dd9227700 1 -- 172.21.15.50:0/965436512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f4dd4056340 con 0x7f4dd4062610 2019-12-19T22:08:05.376 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.373+0000 7f4dd359e700 1 --2- 172.21.15.50:0/965436512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dd4062610 0x7f4dd405fad0 secure :-1 s=THROTTLE_DONE pgs=65 cs=0 l=1 rx=0x7f4dc4008790 tx=0x7f4dc40112f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:05.376 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.373+0000 7f4dbbfff700 1 -- 172.21.15.50:0/965436512 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v14) v1 ==== 133+0+0 (secure 0 0 0) 0x7f4dc4000e90 con 0x7f4dd4062610 2019-12-19T22:08:05.380 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.377+0000 7f4dd9227700 1 -- 172.21.15.50:0/965436512 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f4db401f960 msgr2=0x7f4db4021e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:05.380 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.377+0000 7f4dd9227700 1 --2- 172.21.15.50:0/965436512 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f4db401f960 0x7f4db4021e70 crc :-1 s=READY pgs=15 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:05.381 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.377+0000 7f4dd9227700 1 -- 172.21.15.50:0/965436512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dd4062610 msgr2=0x7f4dd405fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:05.381 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.377+0000 7f4dd9227700 1 --2- 172.21.15.50:0/965436512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dd4062610 0x7f4dd405fad0 secure :-1 s=READY pgs=65 cs=0 l=1 rx=0x7f4dc4008790 tx=0x7f4dc40112f0).stop 2019-12-19T22:08:05.381 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.377+0000 7f4dd9227700 1 -- 172.21.15.50:0/965436512 shutdown_connections 2019-12-19T22:08:05.381 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.377+0000 7f4dd9227700 1 --2- 172.21.15.50:0/965436512 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f4db401f960 0x7f4db4021e70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:05.381 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.377+0000 7f4dd9227700 1 --2- 172.21.15.50:0/965436512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dd4062610 0x7f4dd405fad0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:05.381 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.378+0000 7f4dd9227700 1 -- 172.21.15.50:0/965436512 shutdown_connections 2019-12-19T22:08:05.381 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.378+0000 7f4dd9227700 1 -- 172.21.15.50:0/965436512 wait complete. 2019-12-19T22:08:05.382 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.378+0000 7f4dd9227700 1 -- 172.21.15.50:0/965436512 >> 172.21.15.50:0/965436512 conn(0x7f4dd408ffa0 msgr2=0x7f4dd4089720 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:05.382 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_metadata' created 2019-12-19T22:08:05.392 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2019-12-19T22:08:05.536 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.513+0000 7f3a11b9d700 1 Processor -- start 2019-12-19T22:08:05.537 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.514+0000 7f3a11b9d700 1 -- start start 2019-12-19T22:08:05.537 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.514+0000 7f3a11b9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3a0c062d90 0x7f3a0c080060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:05.537 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.514+0000 7f3a11b9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a0c062a50 con 0x7f3a0c0636d0 2019-12-19T22:08:05.537 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.514+0000 7f3a11b9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a0c063cb0 con 0x7f3a0c062d90 2019-12-19T22:08:05.538 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.514+0000 7f3a10b9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3a0c062d90 0x7f3a0c080060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:05.538 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.514+0000 7f3a10b9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3a0c062d90 0x7f3a0c080060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53488/0 (socket says 172.21.15.50:53488) 2019-12-19T22:08:05.538 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.514+0000 7f3a10b9b700 1 -- 172.21.15.50:0/933917764 learned_addr learned my addr 172.21.15.50:0/933917764 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:05.538 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.514+0000 7f3a1139c700 1 --1- 172.21.15.50:0/933917764 >> v1:172.21.15.50:6789/0 conn(0x7f3a0c0636d0 0x7f3a0c07f860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39616/0 (socket says 172.21.15.50:39616) 2019-12-19T22:08:05.539 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.514+0000 7f3a10b9b700 1 -- 172.21.15.50:0/933917764 >> v1:172.21.15.50:6789/0 conn(0x7f3a0c0636d0 legacy=0x7f3a0c07f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:05.539 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.514+0000 7f3a10b9b700 1 -- 172.21.15.50:0/933917764 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a0c0805b0 con 0x7f3a0c062d90 2019-12-19T22:08:05.539 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.515+0000 7f3a10b9b700 1 --2- 172.21.15.50:0/933917764 >> v2:172.21.15.50:3300/0 conn(0x7f3a0c062d90 0x7f3a0c080060 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f39fc008790 tx=0x7f39fc00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:05.539 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.515+0000 7f3a10b9b700 1 --2- 172.21.15.50:0/933917764 >> v2:172.21.15.50:3300/0 conn(0x7f3a0c062d90 0x7f3a0c080060 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f39fc008790 tx=0x7f39fc00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:05.539 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.515+0000 7f3a10b9b700 1 --2- 172.21.15.50:0/933917764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a0c062d90 0x7f3a0c080060 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7f39fc008790 tx=0x7f39fc00fcb0).ready entity=mon.0 client_cookie=b74874750e8c5203 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:05.539 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.515+0000 7f3a10b9b700 1 --2- 172.21.15.50:0/933917764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a0c062d90 0x7f3a0c080060 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f39fc008790 tx=0x7f39fc00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:05.539 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.515+0000 7f3a03fff700 1 -- 172.21.15.50:0/933917764 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f39fc011330 con 0x7f3a0c062d90 2019-12-19T22:08:05.540 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.515+0000 7f3a10b9b700 1 --2- 172.21.15.50:0/933917764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a0c062d90 0x7f3a0c080060 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f39fc008790 tx=0x7f39fc00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:05.540 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.515+0000 7f3a10b9b700 1 --2- 172.21.15.50:0/933917764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a0c062d90 0x7f3a0c080060 secure :-1 s=THROTTLE_DONE pgs=67 cs=0 l=1 rx=0x7f39fc008790 tx=0x7f39fc00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:05.540 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.515+0000 7f3a03fff700 1 -- 172.21.15.50:0/933917764 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39fc011530 con 0x7f3a0c062d90 2019-12-19T22:08:05.540 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.515+0000 7f3a03fff700 1 -- 172.21.15.50:0/933917764 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f39fc011850 con 0x7f3a0c062d90 2019-12-19T22:08:05.540 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.515+0000 7f3a11b9d700 1 -- 172.21.15.50:0/933917764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a0c062d90 msgr2=0x7f3a0c080060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:05.540 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.515+0000 7f3a11b9d700 1 --2- 172.21.15.50:0/933917764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a0c062d90 0x7f3a0c080060 secure :-1 s=READY pgs=67 cs=0 l=1 rx=0x7f39fc008790 tx=0x7f39fc00fcb0).stop 2019-12-19T22:08:05.540 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.515+0000 7f3a11b9d700 1 -- 172.21.15.50:0/933917764 shutdown_connections 2019-12-19T22:08:05.541 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.515+0000 7f3a11b9d700 1 --2- 172.21.15.50:0/933917764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a0c062d90 0x7f3a0c080060 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:05.541 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.515+0000 7f3a11b9d700 1 -- 172.21.15.50:0/933917764 shutdown_connections 2019-12-19T22:08:05.541 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.515+0000 7f3a11b9d700 1 -- 172.21.15.50:0/933917764 wait complete. 2019-12-19T22:08:05.541 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.515+0000 7f3a11b9d700 1 -- 172.21.15.50:0/933917764 >> 172.21.15.50:0/933917764 conn(0x7f3a0c095760 msgr2=0x7f3a0c095b90 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:05.541 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.516+0000 7f3a11b9d700 1 Processor -- start 2019-12-19T22:08:05.541 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.516+0000 7f3a11b9d700 1 -- start start 2019-12-19T22:08:05.541 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.517+0000 7f3a11b9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3a0c121050 0x7f3a0c123490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:05.542 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.517+0000 7f3a11b9d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a0c11ea90 con 0x7f3a0c092e40 2019-12-19T22:08:05.542 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.517+0000 7f3a11b9d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a0c090640 con 0x7f3a0c121050 2019-12-19T22:08:05.542 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.517+0000 7f3a10b9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3a0c121050 0x7f3a0c123490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:05.542 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.517+0000 7f3a10b9b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3a0c121050 0x7f3a0c123490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53494/0 (socket says 172.21.15.50:53494) 2019-12-19T22:08:05.542 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.517+0000 7f3a1139c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f3a0c092e40 0x7f3a0c11e290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39620/0 (socket says 172.21.15.50:39620) 2019-12-19T22:08:05.542 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.517+0000 7f3a10b9b700 1 -- 172.21.15.50:0/3134626823 learned_addr learned my addr 172.21.15.50:0/3134626823 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:05.542 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.517+0000 7f3a10b9b700 1 -- 172.21.15.50:0/3134626823 >> v1:172.21.15.50:6789/0 conn(0x7f3a0c092e40 legacy=0x7f3a0c11e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:05.543 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.517+0000 7f3a10b9b700 1 -- 172.21.15.50:0/3134626823 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a0c0911b0 con 0x7f3a0c121050 2019-12-19T22:08:05.543 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.517+0000 7f3a01ffb700 1 -- 172.21.15.50:0/3134626823 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2294699673 0 0) 0x7f3a0c11ea90 con 0x7f3a0c092e40 2019-12-19T22:08:05.543 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.517+0000 7f3a10b9b700 1 --2- 172.21.15.50:0/3134626823 >> v2:172.21.15.50:3300/0 conn(0x7f3a0c121050 0x7f3a0c123490 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f39fc008790 tx=0x7f39fc00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:05.543 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.517+0000 7f3a10b9b700 1 --2- 172.21.15.50:0/3134626823 >> v2:172.21.15.50:3300/0 conn(0x7f3a0c121050 0x7f3a0c123490 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f39fc008790 tx=0x7f39fc00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:05.543 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.517+0000 7f3a10b9b700 1 --2- 172.21.15.50:0/3134626823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a0c121050 0x7f3a0c123490 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f39fc008790 tx=0x7f39fc00f780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:05.543 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.517+0000 7f3a10b9b700 1 --2- 172.21.15.50:0/3134626823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a0c121050 0x7f3a0c123490 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f39fc008790 tx=0x7f39fc00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:05.543 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.517+0000 7f3a01ffb700 1 -- 172.21.15.50:0/3134626823 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f39fc007280 con 0x7f3a0c121050 2019-12-19T22:08:05.544 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.517+0000 7f3a10b9b700 1 --2- 172.21.15.50:0/3134626823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a0c121050 0x7f3a0c123490 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f39fc008790 tx=0x7f39fc00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:05.544 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.518+0000 7f3a10b9b700 1 --2- 172.21.15.50:0/3134626823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a0c121050 0x7f3a0c123490 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f39fc008790 tx=0x7f39fc00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:05.544 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.518+0000 7f3a01ffb700 1 -- 172.21.15.50:0/3134626823 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39fc011540 con 0x7f3a0c121050 2019-12-19T22:08:05.544 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.518+0000 7f3a11b9d700 1 -- 172.21.15.50:0/3134626823 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a0c091bc0 con 0x7f3a0c121050 2019-12-19T22:08:05.544 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.518+0000 7f3a01ffb700 1 -- 172.21.15.50:0/3134626823 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f39fc0118a0 con 0x7f3a0c121050 2019-12-19T22:08:05.544 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.518+0000 7f3a11b9d700 1 -- 172.21.15.50:0/3134626823 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a0c0926b0 con 0x7f3a0c121050 2019-12-19T22:08:05.544 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.518+0000 7f3a10b9b700 1 --2- 172.21.15.50:0/3134626823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a0c121050 0x7f3a0c123490 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f39fc008790 tx=0x7f39fc00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:05.544 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.518+0000 7f3a01ffb700 1 -- 172.21.15.50:0/3134626823 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7f39fc005540 con 0x7f3a0c121050 2019-12-19T22:08:05.545 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.518+0000 7f3a10b9b700 1 --2- 172.21.15.50:0/3134626823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a0c121050 0x7f3a0c123490 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f39fc008790 tx=0x7f39fc00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:05.545 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.518+0000 7f3a01ffb700 1 --2- 172.21.15.50:0/3134626823 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f39ec021c00 0x7f39ec024110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:05.545 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.518+0000 7f3a01ffb700 1 -- 172.21.15.50:0/3134626823 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2937+0+0 (secure 0 0 0) 0x7f39fc02a9f0 con 0x7f3a0c121050 2019-12-19T22:08:05.545 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.518+0000 7f3a1139c700 1 --2- 172.21.15.50:0/3134626823 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f39ec021c00 0x7f39ec024110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:05.545 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.519+0000 7f3a11b9d700 1 -- 172.21.15.50:0/3134626823 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a0c056340 con 0x7f3a0c121050 2019-12-19T22:08:05.545 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.519+0000 7f3a1139c700 1 --2- 172.21.15.50:0/3134626823 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f39ec021c00 0x7f39ec024110 crc :-1 s=READY pgs=16 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:05.545 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.522+0000 7f3a10b9b700 1 --2- 172.21.15.50:0/3134626823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a0c121050 0x7f3a0c123490 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f39fc008790 tx=0x7f39fc00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:05.546 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.522+0000 7f3a01ffb700 1 -- 172.21.15.50:0/3134626823 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7f39fc005d20 con 0x7f3a0c121050 2019-12-19T22:08:05.665 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:05.663+0000 7f3a11b9d700 1 -- 172.21.15.50:0/3134626823 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f3a0c096520 con 0x7f3a0c121050 2019-12-19T22:08:06.378 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.376+0000 7f3a10b9b700 1 --2- 172.21.15.50:0/3134626823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a0c121050 0x7f3a0c123490 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f39fc008790 tx=0x7f39fc00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:06.378 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.376+0000 7f3a01ffb700 1 -- 172.21.15.50:0/3134626823 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v15) v1 ==== 125+0+0 (secure 0 0 0) 0x7f39fc005850 con 0x7f3a0c121050 2019-12-19T22:08:06.384 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.381+0000 7f3a11b9d700 1 -- 172.21.15.50:0/3134626823 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f39ec021c00 msgr2=0x7f39ec024110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:06.384 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.381+0000 7f3a11b9d700 1 --2- 172.21.15.50:0/3134626823 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f39ec021c00 0x7f39ec024110 crc :-1 s=READY pgs=16 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:06.385 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.381+0000 7f3a11b9d700 1 -- 172.21.15.50:0/3134626823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a0c121050 msgr2=0x7f3a0c123490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:06.385 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.381+0000 7f3a11b9d700 1 --2- 172.21.15.50:0/3134626823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a0c121050 0x7f3a0c123490 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f39fc008790 tx=0x7f39fc00f780).stop 2019-12-19T22:08:06.387 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.383+0000 7f3a11b9d700 1 -- 172.21.15.50:0/3134626823 shutdown_connections 2019-12-19T22:08:06.387 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.383+0000 7f3a11b9d700 1 --2- 172.21.15.50:0/3134626823 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f39ec021c00 0x7f39ec024110 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:06.387 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.383+0000 7f3a11b9d700 1 --2- 172.21.15.50:0/3134626823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a0c121050 0x7f3a0c123490 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:06.387 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.384+0000 7f3a11b9d700 1 -- 172.21.15.50:0/3134626823 shutdown_connections 2019-12-19T22:08:06.387 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.384+0000 7f3a11b9d700 1 -- 172.21.15.50:0/3134626823 wait complete. 2019-12-19T22:08:06.388 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.384+0000 7f3a11b9d700 1 -- 172.21.15.50:0/3134626823 >> 172.21.15.50:0/3134626823 conn(0x7f3a0c061350 msgr2=0x7f3a0c0650d0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:06.388 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'cephfs_data' created 2019-12-19T22:08:06.399 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2019-12-19T22:08:06.529 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.522+0000 7f685cd35700 1 Processor -- start 2019-12-19T22:08:06.529 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.522+0000 7f685cd35700 1 -- start start 2019-12-19T22:08:06.530 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.522+0000 7f685cd35700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f685808eb70 0x7f685807e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:06.530 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.522+0000 7f685cd35700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f685808fd30 con 0x7f685807dac0 2019-12-19T22:08:06.530 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.522+0000 7f685cd35700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6858089d10 con 0x7f685808eb70 2019-12-19T22:08:06.530 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.522+0000 7f685659c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f685808eb70 0x7f685807e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:06.530 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.522+0000 7f6856d9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f685807dac0 0x7f6858089510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39626/0 (socket says 172.21.15.50:39626) 2019-12-19T22:08:06.530 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.522+0000 7f6856d9d700 1 -- 172.21.15.50:0/2258855798 learned_addr learned my addr 172.21.15.50:0/2258855798 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:06.530 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.523+0000 7f685659c700 1 -- 172.21.15.50:0/2258855798 >> v1:172.21.15.50:6789/0 conn(0x7f685807dac0 legacy=0x7f6858089510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:06.531 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.523+0000 7f685659c700 1 -- 172.21.15.50:0/2258855798 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f685808f8f0 con 0x7f685808eb70 2019-12-19T22:08:06.531 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.523+0000 7f685659c700 1 --2- 172.21.15.50:0/2258855798 >> v2:172.21.15.50:3300/0 conn(0x7f685808eb70 0x7f685807e000 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f684c008790 tx=0x7f684c00fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:06.531 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.523+0000 7f685659c700 1 --2- 172.21.15.50:0/2258855798 >> v2:172.21.15.50:3300/0 conn(0x7f685808eb70 0x7f685807e000 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f684c008790 tx=0x7f684c00fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:06.531 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.523+0000 7f685659c700 1 --2- 172.21.15.50:0/2258855798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f685808eb70 0x7f685807e000 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7f684c008790 tx=0x7f684c00fbf0).ready entity=mon.0 client_cookie=a92bf91b6731cf2b server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:06.531 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.523+0000 7f685659c700 1 --2- 172.21.15.50:0/2258855798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f685808eb70 0x7f685807e000 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f684c008790 tx=0x7f684c00fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:06.531 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.523+0000 7f6855d9b700 1 -- 172.21.15.50:0/2258855798 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f684c011270 con 0x7f685808eb70 2019-12-19T22:08:06.532 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.523+0000 7f685659c700 1 --2- 172.21.15.50:0/2258855798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f685808eb70 0x7f685807e000 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f684c008790 tx=0x7f684c00fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:06.532 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.523+0000 7f685659c700 1 --2- 172.21.15.50:0/2258855798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f685808eb70 0x7f685807e000 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f684c008790 tx=0x7f684c00fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:06.532 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.523+0000 7f6855d9b700 1 -- 172.21.15.50:0/2258855798 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f684c011470 con 0x7f685808eb70 2019-12-19T22:08:06.532 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.523+0000 7f6855d9b700 1 -- 172.21.15.50:0/2258855798 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f684c0117d0 con 0x7f685808eb70 2019-12-19T22:08:06.532 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.523+0000 7f685cd35700 1 -- 172.21.15.50:0/2258855798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f685808eb70 msgr2=0x7f685807e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:06.532 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.523+0000 7f685cd35700 1 --2- 172.21.15.50:0/2258855798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f685808eb70 0x7f685807e000 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7f684c008790 tx=0x7f684c00fbf0).stop 2019-12-19T22:08:06.532 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.523+0000 7f685cd35700 1 -- 172.21.15.50:0/2258855798 shutdown_connections 2019-12-19T22:08:06.533 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.523+0000 7f685cd35700 1 --2- 172.21.15.50:0/2258855798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f685808eb70 0x7f685807e000 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:06.533 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.524+0000 7f685cd35700 1 -- 172.21.15.50:0/2258855798 shutdown_connections 2019-12-19T22:08:06.533 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.524+0000 7f685cd35700 1 -- 172.21.15.50:0/2258855798 wait complete. 2019-12-19T22:08:06.533 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.524+0000 7f685cd35700 1 -- 172.21.15.50:0/2258855798 >> 172.21.15.50:0/2258855798 conn(0x7f6858092f20 msgr2=0x7f685808b240 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:06.533 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.524+0000 7f685cd35700 1 Processor -- start 2019-12-19T22:08:06.533 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.525+0000 7f685cd35700 1 -- start start 2019-12-19T22:08:06.534 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.525+0000 7f685cd35700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6858124fa0 0x7f68581273e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:06.534 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.525+0000 7f685cd35700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6858082df0 con 0x7f68580604a0 2019-12-19T22:08:06.534 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.525+0000 7f685cd35700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6858060070 con 0x7f6858124fa0 2019-12-19T22:08:06.535 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.525+0000 7f6856d9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f68580604a0 0x7f68580608d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39630/0 (socket says 172.21.15.50:39630) 2019-12-19T22:08:06.535 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.525+0000 7f6856d9d700 1 -- 172.21.15.50:0/2463993727 learned_addr learned my addr 172.21.15.50:0/2463993727 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:06.535 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.525+0000 7f685659c700 1 --2- 172.21.15.50:0/2463993727 >> v2:172.21.15.50:3300/0 conn(0x7f6858124fa0 0x7f68581273e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:06.535 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.525+0000 7f685659c700 1 -- 172.21.15.50:0/2463993727 >> v1:172.21.15.50:6789/0 conn(0x7f68580604a0 legacy=0x7f68580608d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:06.535 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.525+0000 7f685659c700 1 -- 172.21.15.50:0/2463993727 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6858091070 con 0x7f6858124fa0 2019-12-19T22:08:06.535 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.525+0000 7f68477fe700 1 -- 172.21.15.50:0/2463993727 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2115538189 0 0) 0x7f6858082df0 con 0x7f68580604a0 2019-12-19T22:08:06.535 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.525+0000 7f685659c700 1 --2- 172.21.15.50:0/2463993727 >> v2:172.21.15.50:3300/0 conn(0x7f6858124fa0 0x7f68581273e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f684c008790 tx=0x7f684c00f510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:06.536 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.525+0000 7f685659c700 1 --2- 172.21.15.50:0/2463993727 >> v2:172.21.15.50:3300/0 conn(0x7f6858124fa0 0x7f68581273e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f684c008790 tx=0x7f684c00f510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:06.536 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.525+0000 7f685659c700 1 --2- 172.21.15.50:0/2463993727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6858124fa0 0x7f68581273e0 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7f684c008790 tx=0x7f684c00f510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:06.536 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.526+0000 7f685659c700 1 --2- 172.21.15.50:0/2463993727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6858124fa0 0x7f68581273e0 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f684c008790 tx=0x7f684c00f510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:06.536 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.526+0000 7f68477fe700 1 -- 172.21.15.50:0/2463993727 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f684c007280 con 0x7f6858124fa0 2019-12-19T22:08:06.536 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.526+0000 7f685659c700 1 --2- 172.21.15.50:0/2463993727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6858124fa0 0x7f68581273e0 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f684c008790 tx=0x7f684c00f510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:06.536 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.526+0000 7f685659c700 1 --2- 172.21.15.50:0/2463993727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6858124fa0 0x7f68581273e0 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f684c008790 tx=0x7f684c00f510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:06.537 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.526+0000 7f68477fe700 1 -- 172.21.15.50:0/2463993727 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f684c011480 con 0x7f6858124fa0 2019-12-19T22:08:06.537 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.526+0000 7f68477fe700 1 -- 172.21.15.50:0/2463993727 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f684c0117a0 con 0x7f6858124fa0 2019-12-19T22:08:06.537 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.526+0000 7f685cd35700 1 -- 172.21.15.50:0/2463993727 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6858061820 con 0x7f6858124fa0 2019-12-19T22:08:06.537 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.526+0000 7f685cd35700 1 -- 172.21.15.50:0/2463993727 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f685807b080 con 0x7f6858124fa0 2019-12-19T22:08:06.537 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.526+0000 7f685659c700 1 --2- 172.21.15.50:0/2463993727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6858124fa0 0x7f68581273e0 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f684c008790 tx=0x7f684c00f510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:06.537 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.526+0000 7f68477fe700 1 -- 172.21.15.50:0/2463993727 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7f684c005540 con 0x7f6858124fa0 2019-12-19T22:08:06.538 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.526+0000 7f685659c700 1 --2- 172.21.15.50:0/2463993727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6858124fa0 0x7f68581273e0 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f684c008790 tx=0x7f684c00f510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:06.538 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.526+0000 7f68477fe700 1 --2- 172.21.15.50:0/2463993727 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f683c01f9f0 0x7f683c021f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:06.538 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.526+0000 7f68477fe700 1 -- 172.21.15.50:0/2463993727 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3287+0+0 (secure 0 0 0) 0x7f684c02aad0 con 0x7f6858124fa0 2019-12-19T22:08:06.538 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.526+0000 7f6856d9d700 1 --2- 172.21.15.50:0/2463993727 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f683c01f9f0 0x7f683c021f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:06.538 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.527+0000 7f6856d9d700 1 --2- 172.21.15.50:0/2463993727 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f683c01f9f0 0x7f683c021f00 crc :-1 s=READY pgs=17 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:06.538 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.527+0000 7f685cd35700 1 -- 172.21.15.50:0/2463993727 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6858056340 con 0x7f6858124fa0 2019-12-19T22:08:06.539 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.530+0000 7f685659c700 1 --2- 172.21.15.50:0/2463993727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6858124fa0 0x7f68581273e0 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f684c008790 tx=0x7f684c00f510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:06.539 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.530+0000 7f68477fe700 1 -- 172.21.15.50:0/2463993727 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7f684c02ade0 con 0x7f6858124fa0 2019-12-19T22:08:06.714 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.708+0000 7f685cd35700 1 -- 172.21.15.50:0/2463993727 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f68580906b0 con 0x7f6858124fa0 2019-12-19T22:08:06.714 INFO:tasks.ceph.mon.a.smithi050.stderr:2019-12-19T22:08:06.709+0000 7f71b21f9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2019-12-19T22:08:06.715 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.711+0000 7f685659c700 1 --2- 172.21.15.50:0/2463993727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6858124fa0 0x7f68581273e0 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f684c008790 tx=0x7f684c00f510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:06.715 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.711+0000 7f68477fe700 1 -- 172.21.15.50:0/2463993727 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v2) v1 ==== 172+0+0 (secure 0 0 0) 0x7f684c005d70 con 0x7f6858124fa0 2019-12-19T22:08:06.721 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.716+0000 7f685cd35700 1 -- 172.21.15.50:0/2463993727 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f683c01f9f0 msgr2=0x7f683c021f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:06.721 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.716+0000 7f685cd35700 1 --2- 172.21.15.50:0/2463993727 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f683c01f9f0 0x7f683c021f00 crc :-1 s=READY pgs=17 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:06.722 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.716+0000 7f685cd35700 1 -- 172.21.15.50:0/2463993727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6858124fa0 msgr2=0x7f68581273e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:06.722 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.716+0000 7f685cd35700 1 --2- 172.21.15.50:0/2463993727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6858124fa0 0x7f68581273e0 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7f684c008790 tx=0x7f684c00f510).stop 2019-12-19T22:08:06.722 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.716+0000 7f685cd35700 1 -- 172.21.15.50:0/2463993727 shutdown_connections 2019-12-19T22:08:06.723 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.716+0000 7f685cd35700 1 --2- 172.21.15.50:0/2463993727 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f683c01f9f0 0x7f683c021f00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:06.723 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.716+0000 7f685cd35700 1 --2- 172.21.15.50:0/2463993727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6858124fa0 0x7f68581273e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:06.724 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.716+0000 7f685cd35700 1 -- 172.21.15.50:0/2463993727 shutdown_connections 2019-12-19T22:08:06.724 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.717+0000 7f685cd35700 1 -- 172.21.15.50:0/2463993727 wait complete. 2019-12-19T22:08:06.724 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.717+0000 7f685cd35700 1 -- 172.21.15.50:0/2463993727 >> 172.21.15.50:0/2463993727 conn(0x7f68580919e0 msgr2=0x7f685807d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:06.724 INFO:teuthology.orchestra.run.smithi050.stderr:new fs with metadata pool 2 and data pool 3 2019-12-19T22:08:06.731 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-12-19T22:08:06.850 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.843+0000 7f8969d5e700 1 Processor -- start 2019-12-19T22:08:06.851 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.843+0000 7f8969d5e700 1 -- start start 2019-12-19T22:08:06.851 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.843+0000 7f8969d5e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f89640898b0 0x7f8964081170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:06.851 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.843+0000 7f8969d5e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8964089ce0 con 0x7f8964089480 2019-12-19T22:08:06.851 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.843+0000 7f8969d5e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f896408ae60 con 0x7f89640898b0 2019-12-19T22:08:06.851 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.844+0000 7f895bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f89640898b0 0x7f8964081170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:06.852 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.844+0000 7f895bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f89640898b0 0x7f8964081170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53508/0 (socket says 172.21.15.50:53508) 2019-12-19T22:08:06.852 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.844+0000 7f8963fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8964089480 0x7f896408f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39636/0 (socket says 172.21.15.50:39636) 2019-12-19T22:08:06.852 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.844+0000 7f895bfff700 1 -- 172.21.15.50:0/2240309938 learned_addr learned my addr 172.21.15.50:0/2240309938 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:06.852 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.844+0000 7f895bfff700 1 -- 172.21.15.50:0/2240309938 >> v1:172.21.15.50:6789/0 conn(0x7f8964089480 legacy=0x7f896408f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:06.852 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.844+0000 7f895bfff700 1 -- 172.21.15.50:0/2240309938 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f896408edb0 con 0x7f89640898b0 2019-12-19T22:08:06.852 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.844+0000 7f895bfff700 1 --2- 172.21.15.50:0/2240309938 >> v2:172.21.15.50:3300/0 conn(0x7f89640898b0 0x7f8964081170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f894c008790 tx=0x7f894c00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:06.852 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.844+0000 7f895bfff700 1 --2- 172.21.15.50:0/2240309938 >> v2:172.21.15.50:3300/0 conn(0x7f89640898b0 0x7f8964081170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f894c008790 tx=0x7f894c00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:06.853 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.844+0000 7f895bfff700 1 --2- 172.21.15.50:0/2240309938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89640898b0 0x7f8964081170 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7f894c008790 tx=0x7f894c00fcb0).ready entity=mon.0 client_cookie=ac9ab80510e67eaf server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:06.853 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.844+0000 7f895bfff700 1 --2- 172.21.15.50:0/2240309938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89640898b0 0x7f8964081170 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f894c008790 tx=0x7f894c00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:06.853 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.844+0000 7f89637fe700 1 -- 172.21.15.50:0/2240309938 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f894c011330 con 0x7f89640898b0 2019-12-19T22:08:06.853 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.844+0000 7f895bfff700 1 --2- 172.21.15.50:0/2240309938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89640898b0 0x7f8964081170 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f894c008790 tx=0x7f894c00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:06.867 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.844+0000 7f895bfff700 1 --2- 172.21.15.50:0/2240309938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89640898b0 0x7f8964081170 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f894c008790 tx=0x7f894c00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:06.868 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.844+0000 7f89637fe700 1 -- 172.21.15.50:0/2240309938 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f894c011530 con 0x7f89640898b0 2019-12-19T22:08:06.868 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.844+0000 7f89637fe700 1 -- 172.21.15.50:0/2240309938 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f894c011850 con 0x7f89640898b0 2019-12-19T22:08:06.868 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.844+0000 7f8969d5e700 1 -- 172.21.15.50:0/2240309938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89640898b0 msgr2=0x7f8964081170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:06.868 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.844+0000 7f8969d5e700 1 --2- 172.21.15.50:0/2240309938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89640898b0 0x7f8964081170 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7f894c008790 tx=0x7f894c00fcb0).stop 2019-12-19T22:08:06.868 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.845+0000 7f8969d5e700 1 -- 172.21.15.50:0/2240309938 shutdown_connections 2019-12-19T22:08:06.868 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.845+0000 7f8969d5e700 1 --2- 172.21.15.50:0/2240309938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89640898b0 0x7f8964081170 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:06.869 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.845+0000 7f8969d5e700 1 -- 172.21.15.50:0/2240309938 shutdown_connections 2019-12-19T22:08:06.869 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.845+0000 7f8969d5e700 1 -- 172.21.15.50:0/2240309938 wait complete. 2019-12-19T22:08:06.869 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.845+0000 7f8969d5e700 1 -- 172.21.15.50:0/2240309938 >> 172.21.15.50:0/2240309938 conn(0x7f8964067e70 msgr2=0x7f8964094570 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:06.869 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.846+0000 7f8969d5e700 1 Processor -- start 2019-12-19T22:08:06.869 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.846+0000 7f8969d5e700 1 -- start start 2019-12-19T22:08:06.869 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.846+0000 7f8969d5e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8964122aa0 0x7f8964124ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:06.869 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.846+0000 7f8969d5e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89640874b0 con 0x7f896411f780 2019-12-19T22:08:06.869 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.846+0000 7f8969d5e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8964090a20 con 0x7f8964122aa0 2019-12-19T22:08:06.870 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.846+0000 7f895bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8964122aa0 0x7f8964124ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:06.870 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.846+0000 7f8963fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f896411f780 0x7f896411fbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39640/0 (socket says 172.21.15.50:39640) 2019-12-19T22:08:06.872 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.846+0000 7f8963fff700 1 -- 172.21.15.50:0/17210524 learned_addr learned my addr 172.21.15.50:0/17210524 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:06.873 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.847+0000 7f895bfff700 1 -- 172.21.15.50:0/17210524 >> v1:172.21.15.50:6789/0 conn(0x7f896411f780 legacy=0x7f896411fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:06.873 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.847+0000 7f895bfff700 1 -- 172.21.15.50:0/17210524 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8964087100 con 0x7f8964122aa0 2019-12-19T22:08:06.873 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.847+0000 7f89617fa700 1 -- 172.21.15.50:0/17210524 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2646811086 0 0) 0x7f89640874b0 con 0x7f896411f780 2019-12-19T22:08:06.873 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.847+0000 7f895bfff700 1 --2- 172.21.15.50:0/17210524 >> v2:172.21.15.50:3300/0 conn(0x7f8964122aa0 0x7f8964124ee0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8964090900 tx=0x7f894c00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:06.873 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.847+0000 7f895bfff700 1 --2- 172.21.15.50:0/17210524 >> v2:172.21.15.50:3300/0 conn(0x7f8964122aa0 0x7f8964124ee0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8964090900 tx=0x7f894c00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:06.873 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.847+0000 7f895bfff700 1 --2- 172.21.15.50:0/17210524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8964122aa0 0x7f8964124ee0 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7f8964090900 tx=0x7f894c00f780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:06.874 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.847+0000 7f895bfff700 1 --2- 172.21.15.50:0/17210524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8964122aa0 0x7f8964124ee0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f8964090900 tx=0x7f894c00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:06.874 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.847+0000 7f89617fa700 1 -- 172.21.15.50:0/17210524 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f894c007280 con 0x7f8964122aa0 2019-12-19T22:08:06.874 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.847+0000 7f895bfff700 1 --2- 172.21.15.50:0/17210524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8964122aa0 0x7f8964124ee0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f8964090900 tx=0x7f894c00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:06.874 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.847+0000 7f895bfff700 1 --2- 172.21.15.50:0/17210524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8964122aa0 0x7f8964124ee0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f8964090900 tx=0x7f894c00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:06.874 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.847+0000 7f89617fa700 1 -- 172.21.15.50:0/17210524 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f894c0115c0 con 0x7f8964122aa0 2019-12-19T22:08:06.874 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.847+0000 7f89617fa700 1 -- 172.21.15.50:0/17210524 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f894c0118e0 con 0x7f8964122aa0 2019-12-19T22:08:06.874 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.847+0000 7f8969d5e700 1 -- 172.21.15.50:0/17210524 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8964085e10 con 0x7f8964122aa0 2019-12-19T22:08:06.875 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.847+0000 7f8969d5e700 1 -- 172.21.15.50:0/17210524 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8964086590 con 0x7f8964122aa0 2019-12-19T22:08:06.875 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.847+0000 7f895bfff700 1 --2- 172.21.15.50:0/17210524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8964122aa0 0x7f8964124ee0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f8964090900 tx=0x7f894c00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:06.875 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.847+0000 7f89617fa700 1 -- 172.21.15.50:0/17210524 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7f894c005540 con 0x7f8964122aa0 2019-12-19T22:08:06.875 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.847+0000 7f895bfff700 1 --2- 172.21.15.50:0/17210524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8964122aa0 0x7f8964124ee0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f8964090900 tx=0x7f894c00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:06.875 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.848+0000 7f89617fa700 1 --2- 172.21.15.50:0/17210524 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f894801f990 0x7f8948021ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:06.875 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.848+0000 7f89617fa700 1 -- 172.21.15.50:0/17210524 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3403+0+0 (secure 0 0 0) 0x7f894c02aa20 con 0x7f8964122aa0 2019-12-19T22:08:06.876 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.848+0000 7f8963fff700 1 --2- 172.21.15.50:0/17210524 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f894801f990 0x7f8948021ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:06.876 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.848+0000 7f8963fff700 1 --2- 172.21.15.50:0/17210524 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f894801f990 0x7f8948021ea0 crc :-1 s=READY pgs=18 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:06.876 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.848+0000 7f8969d5e700 1 -- 172.21.15.50:0/17210524 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8964056340 con 0x7f8964122aa0 2019-12-19T22:08:06.876 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.851+0000 7f895bfff700 1 --2- 172.21.15.50:0/17210524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8964122aa0 0x7f8964124ee0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f8964090900 tx=0x7f894c00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:06.877 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.851+0000 7f89617fa700 1 -- 172.21.15.50:0/17210524 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7f894c005d70 con 0x7f8964122aa0 2019-12-19T22:08:06.990 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.987+0000 7f8969d5e700 1 -- 172.21.15.50:0/17210524 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8964090480 con 0x7f8964122aa0 2019-12-19T22:08:06.991 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.988+0000 7f895bfff700 1 --2- 172.21.15.50:0/17210524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8964122aa0 0x7f8964124ee0 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f8964090900 tx=0x7f894c00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:06.991 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.988+0000 7f89617fa700 1 -- 172.21.15.50:0/17210524 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+8814 (secure 0 0 0) 0x7f894c005850 con 0x7f8964122aa0 2019-12-19T22:08:06.991 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:08:06.992 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":16,"fsid":"c1382993-41cc-4b35-a402-c17778701f01","created":"2019-12-19T22:07:52.345475+0000","modified":"2019-12-19T22:08:06.710454+0000","last_up_change":"2019-12-19T22:07:58.357117+0000","last_in_change":"2019-12-19T22:07:58.357117+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-19T22:08:01.570202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2019-12-19T22:08:04.515784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2019-12-19T22:08:05.689151+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6137ed8c-8e2c-4e88-8634-dc763bed14c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":27757},{"type":"v1","addr":"172.21.15.50:6817","nonce":27757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":27757},{"type":"v1","addr":"172.21.15.50:6819","nonce":27757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":27757},{"type":"v1","addr":"172.21.15.50:6823","nonce":27757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":27757},{"type":"v1","addr":"172.21.15.50:6821","nonce":27757}]},"public_addr":"172.21.15.50:6817/27757","cluster_addr":"172.21.15.50:6819/27757","heartbeat_back_addr":"172.21.15.50:6823/27757","heartbeat_front_addr":"172.21.15.50:6821/27757","state":["exists","up"]},{"osd":1,"uuid":"57d4e31d-408e-4302-859d-7ea672b93772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":27758},{"type":"v1","addr":"172.21.15.50:6801","nonce":27758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":27758},{"type":"v1","addr":"172.21.15.50:6803","nonce":27758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":27758},{"type":"v1","addr":"172.21.15.50:6810","nonce":27758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6805","nonce":27758},{"type":"v1","addr":"172.21.15.50:6807","nonce":27758}]},"public_addr":"172.21.15.50:6801/27758","cluster_addr":"172.21.15.50:6803/27758","heartbeat_back_addr":"172.21.15.50:6810/27758","heartbeat_front_addr":"172.21.15.50:6807/27758","state":["exists","up"]},{"osd":2,"uuid":"600ea585-aa50-4596-9b14-090eab15f9a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":27759},{"type":"v1","addr":"172.21.15.50:6806","nonce":27759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":27759},{"type":"v1","addr":"172.21.15.50:6811","nonce":27759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":27759},{"type":"v1","addr":"172.21.15.50:6816","nonce":27759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":27759},{"type":"v1","addr":"172.21.15.50:6813","nonce":27759}]},"public_addr":"172.21.15.50:6806/27759","cluster_addr":"172.21.15.50:6811/27759","heartbeat_back_addr":"172.21.15.50:6816/27759","heartbeat_front_addr":"172.21.15.50:6813/27759","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-19T22:07:56.415731+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-19T22:07:56.346062+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-19T22:07:56.090889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-19T22:08:06.994 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.989+0000 7f8969d5e700 1 -- 172.21.15.50:0/17210524 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f894801f990 msgr2=0x7f8948021ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:06.994 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.989+0000 7f8969d5e700 1 --2- 172.21.15.50:0/17210524 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f894801f990 0x7f8948021ea0 crc :-1 s=READY pgs=18 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:06.995 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.989+0000 7f8969d5e700 1 -- 172.21.15.50:0/17210524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8964122aa0 msgr2=0x7f8964124ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:06.995 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.989+0000 7f8969d5e700 1 --2- 172.21.15.50:0/17210524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8964122aa0 0x7f8964124ee0 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7f8964090900 tx=0x7f894c00f780).stop 2019-12-19T22:08:06.995 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.989+0000 7f8969d5e700 1 -- 172.21.15.50:0/17210524 shutdown_connections 2019-12-19T22:08:06.995 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.989+0000 7f8969d5e700 1 --2- 172.21.15.50:0/17210524 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f894801f990 0x7f8948021ea0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:06.996 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.989+0000 7f8969d5e700 1 --2- 172.21.15.50:0/17210524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8964122aa0 0x7f8964124ee0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:06.996 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.989+0000 7f8969d5e700 1 -- 172.21.15.50:0/17210524 shutdown_connections 2019-12-19T22:08:06.996 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.989+0000 7f8969d5e700 1 -- 172.21.15.50:0/17210524 wait complete. 2019-12-19T22:08:06.996 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:06.989+0000 7f8969d5e700 1 -- 172.21.15.50:0/17210524 >> 172.21.15.50:0/17210524 conn(0x7f8964091150 msgr2=0x7f896407ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:07.003 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-12-19T22:08:07.127 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.113+0000 7fe7dd9d7700 1 Processor -- start 2019-12-19T22:08:07.127 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.114+0000 7fe7dd9d7700 1 -- start start 2019-12-19T22:08:07.128 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.114+0000 7fe7dd9d7700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe7d80898b0 0x7fe7d8081170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:07.128 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.114+0000 7fe7dd9d7700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7d8089ce0 con 0x7fe7d8089480 2019-12-19T22:08:07.128 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.114+0000 7fe7dd9d7700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7d808ae60 con 0x7fe7d80898b0 2019-12-19T22:08:07.128 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.114+0000 7fe7d6ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe7d80898b0 0x7fe7d8081170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:07.138 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.114+0000 7fe7d6ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe7d80898b0 0x7fe7d8081170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53518/0 (socket says 172.21.15.50:53518) 2019-12-19T22:08:07.138 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.114+0000 7fe7d6ffd700 1 -- 172.21.15.50:0/878045570 learned_addr learned my addr 172.21.15.50:0/878045570 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:07.138 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.114+0000 7fe7d6ffd700 1 -- 172.21.15.50:0/878045570 >> v1:172.21.15.50:6789/0 conn(0x7fe7d8089480 legacy=0x7fe7d808f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:07.138 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.115+0000 7fe7d6ffd700 1 -- 172.21.15.50:0/878045570 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d808edb0 con 0x7fe7d80898b0 2019-12-19T22:08:07.138 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.115+0000 7fe7d6ffd700 1 --2- 172.21.15.50:0/878045570 >> v2:172.21.15.50:3300/0 conn(0x7fe7d80898b0 0x7fe7d8081170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe7c0008790 tx=0x7fe7c000fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:07.139 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.115+0000 7fe7d6ffd700 1 --2- 172.21.15.50:0/878045570 >> v2:172.21.15.50:3300/0 conn(0x7fe7d80898b0 0x7fe7d8081170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe7c0008790 tx=0x7fe7c000fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:07.139 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.115+0000 7fe7d6ffd700 1 --2- 172.21.15.50:0/878045570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7d80898b0 0x7fe7d8081170 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7fe7c0008790 tx=0x7fe7c000fcb0).ready entity=mon.0 client_cookie=f1bfc3320254cc90 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:07.139 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.115+0000 7fe7d6ffd700 1 --2- 172.21.15.50:0/878045570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7d80898b0 0x7fe7d8081170 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7fe7c0008790 tx=0x7fe7c000fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:07.139 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.115+0000 7fe7d67fc700 1 -- 172.21.15.50:0/878045570 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fe7c0011330 con 0x7fe7d80898b0 2019-12-19T22:08:07.139 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.115+0000 7fe7d6ffd700 1 --2- 172.21.15.50:0/878045570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7d80898b0 0x7fe7d8081170 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7fe7c0008790 tx=0x7fe7c000fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:07.139 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.115+0000 7fe7d67fc700 1 -- 172.21.15.50:0/878045570 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c0011530 con 0x7fe7d80898b0 2019-12-19T22:08:07.139 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.115+0000 7fe7d6ffd700 1 --2- 172.21.15.50:0/878045570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7d80898b0 0x7fe7d8081170 secure :-1 s=THROTTLE_DONE pgs=79 cs=0 l=1 rx=0x7fe7c0008790 tx=0x7fe7c000fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:07.140 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.115+0000 7fe7dd9d7700 1 -- 172.21.15.50:0/878045570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7d80898b0 msgr2=0x7fe7d8081170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:07.140 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.115+0000 7fe7d67fc700 1 -- 172.21.15.50:0/878045570 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fe7c0011850 con 0x7fe7d80898b0 2019-12-19T22:08:07.140 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.115+0000 7fe7dd9d7700 1 --2- 172.21.15.50:0/878045570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7d80898b0 0x7fe7d8081170 secure :-1 s=READY pgs=79 cs=0 l=1 rx=0x7fe7c0008790 tx=0x7fe7c000fcb0).stop 2019-12-19T22:08:07.140 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.115+0000 7fe7dd9d7700 1 -- 172.21.15.50:0/878045570 shutdown_connections 2019-12-19T22:08:07.141 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.115+0000 7fe7dd9d7700 1 --2- 172.21.15.50:0/878045570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7d80898b0 0x7fe7d8081170 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:07.141 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.115+0000 7fe7dd9d7700 1 -- 172.21.15.50:0/878045570 shutdown_connections 2019-12-19T22:08:07.141 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.115+0000 7fe7dd9d7700 1 -- 172.21.15.50:0/878045570 wait complete. 2019-12-19T22:08:07.141 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.115+0000 7fe7dd9d7700 1 -- 172.21.15.50:0/878045570 >> 172.21.15.50:0/878045570 conn(0x7fe7d8067e70 msgr2=0x7fe7d8094570 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:07.142 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.116+0000 7fe7dd9d7700 1 Processor -- start 2019-12-19T22:08:07.142 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.116+0000 7fe7dd9d7700 1 -- start start 2019-12-19T22:08:07.142 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.117+0000 7fe7dd9d7700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe7d8077390 0x7fe7d80777c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:07.142 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.117+0000 7fe7dd9d7700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7d8078140 con 0x7fe7d8077d10 2019-12-19T22:08:07.142 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.117+0000 7fe7dd9d7700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7d8090860 con 0x7fe7d8077390 2019-12-19T22:08:07.142 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.117+0000 7fe7d77fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe7d8077390 0x7fe7d80777c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:07.142 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.117+0000 7fe7d6ffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe7d8077d10 0x7fe7d811f6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39650/0 (socket says 172.21.15.50:39650) 2019-12-19T22:08:07.143 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.117+0000 7fe7d6ffd700 1 -- 172.21.15.50:0/3985704559 learned_addr learned my addr 172.21.15.50:0/3985704559 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:07.143 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.117+0000 7fe7cffff700 1 -- 172.21.15.50:0/3985704559 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3949164645 0 0) 0x7fe7d8078140 con 0x7fe7d8077d10 2019-12-19T22:08:07.143 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.117+0000 7fe7cffff700 1 -- 172.21.15.50:0/3985704559 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7bc0030b0 con 0x7fe7d8077d10 2019-12-19T22:08:07.143 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.117+0000 7fe7d77fe700 1 -- 172.21.15.50:0/3985704559 >> v1:172.21.15.50:6789/0 conn(0x7fe7d8077d10 legacy=0x7fe7d811f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:07.143 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.117+0000 7fe7d77fe700 1 -- 172.21.15.50:0/3985704559 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d807a020 con 0x7fe7d8077390 2019-12-19T22:08:07.143 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.117+0000 7fe7d77fe700 1 --2- 172.21.15.50:0/3985704559 >> v2:172.21.15.50:3300/0 conn(0x7fe7d8077390 0x7fe7d80777c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe7c8001430 tx=0x7fe7c80108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:07.143 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.117+0000 7fe7d77fe700 1 --2- 172.21.15.50:0/3985704559 >> v2:172.21.15.50:3300/0 conn(0x7fe7d8077390 0x7fe7d80777c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe7c8001430 tx=0x7fe7c80108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:07.144 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.117+0000 7fe7d77fe700 1 --2- 172.21.15.50:0/3985704559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7d8077390 0x7fe7d80777c0 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7fe7c8001430 tx=0x7fe7c80108f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:07.144 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.118+0000 7fe7d77fe700 1 --2- 172.21.15.50:0/3985704559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7d8077390 0x7fe7d80777c0 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fe7c8001430 tx=0x7fe7c80108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:07.144 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.118+0000 7fe7cffff700 1 -- 172.21.15.50:0/3985704559 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fe7c800c9e0 con 0x7fe7d8077390 2019-12-19T22:08:07.144 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.118+0000 7fe7d77fe700 1 --2- 172.21.15.50:0/3985704559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7d8077390 0x7fe7d80777c0 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fe7c8001430 tx=0x7fe7c80108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:07.144 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.118+0000 7fe7d77fe700 1 --2- 172.21.15.50:0/3985704559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7d8077390 0x7fe7d80777c0 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fe7c8001430 tx=0x7fe7c80108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:07.144 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.118+0000 7fe7cffff700 1 -- 172.21.15.50:0/3985704559 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c800cbe0 con 0x7fe7d8077390 2019-12-19T22:08:07.144 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.118+0000 7fe7dd9d7700 1 -- 172.21.15.50:0/3985704559 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7d807a330 con 0x7fe7d8077390 2019-12-19T22:08:07.145 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.118+0000 7fe7cffff700 1 -- 172.21.15.50:0/3985704559 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fe7c8010e80 con 0x7fe7d8077390 2019-12-19T22:08:07.145 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.118+0000 7fe7dd9d7700 1 -- 172.21.15.50:0/3985704559 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7d80791e0 con 0x7fe7d8077390 2019-12-19T22:08:07.145 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.118+0000 7fe7d77fe700 1 --2- 172.21.15.50:0/3985704559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7d8077390 0x7fe7d80777c0 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fe7c8001430 tx=0x7fe7c80108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:07.145 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.118+0000 7fe7cffff700 1 -- 172.21.15.50:0/3985704559 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7fe7c8007430 con 0x7fe7d8077390 2019-12-19T22:08:07.145 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.118+0000 7fe7d77fe700 1 --2- 172.21.15.50:0/3985704559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7d8077390 0x7fe7d80777c0 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fe7c8001430 tx=0x7fe7c80108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:07.145 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.118+0000 7fe7cffff700 1 --2- 172.21.15.50:0/3985704559 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fe7bc020020 0x7fe7bc022530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:07.145 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.118+0000 7fe7cffff700 1 -- 172.21.15.50:0/3985704559 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3403+0+0 (secure 0 0 0) 0x7fe7c802a470 con 0x7fe7d8077390 2019-12-19T22:08:07.146 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.119+0000 7fe7d6ffd700 1 --2- 172.21.15.50:0/3985704559 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fe7bc020020 0x7fe7bc022530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:07.146 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.119+0000 7fe7d6ffd700 1 --2- 172.21.15.50:0/3985704559 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fe7bc020020 0x7fe7bc022530 crc :-1 s=READY pgs=19 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:07.146 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.119+0000 7fe7dd9d7700 1 -- 172.21.15.50:0/3985704559 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7d8056340 con 0x7fe7d8077390 2019-12-19T22:08:07.146 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.122+0000 7fe7d77fe700 1 --2- 172.21.15.50:0/3985704559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7d8077390 0x7fe7d80777c0 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fe7c8001430 tx=0x7fe7c80108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:07.146 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.122+0000 7fe7cffff700 1 -- 172.21.15.50:0/3985704559 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7fe7c8007ca0 con 0x7fe7d8077390 2019-12-19T22:08:07.261 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.259+0000 7fe7dd9d7700 1 -- 172.21.15.50:0/3985704559 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe7d808dcf0 con 0x7fe7d8077390 2019-12-19T22:08:07.262 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.260+0000 7fe7d77fe700 1 --2- 172.21.15.50:0/3985704559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7d8077390 0x7fe7d80777c0 secure :-1 s=THROTTLE_DONE pgs=81 cs=0 l=1 rx=0x7fe7c8001430 tx=0x7fe7c80108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:07.262 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.260+0000 7fe7cffff700 1 -- 172.21.15.50:0/3985704559 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+8814 (secure 0 0 0) 0x7fe7c8029f50 con 0x7fe7d8077390 2019-12-19T22:08:07.263 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:08:07.263 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":16,"fsid":"c1382993-41cc-4b35-a402-c17778701f01","created":"2019-12-19T22:07:52.345475+0000","modified":"2019-12-19T22:08:06.710454+0000","last_up_change":"2019-12-19T22:07:58.357117+0000","last_in_change":"2019-12-19T22:07:58.357117+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-19T22:08:01.570202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2019-12-19T22:08:04.515784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2019-12-19T22:08:05.689151+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6137ed8c-8e2c-4e88-8634-dc763bed14c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":27757},{"type":"v1","addr":"172.21.15.50:6817","nonce":27757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":27757},{"type":"v1","addr":"172.21.15.50:6819","nonce":27757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":27757},{"type":"v1","addr":"172.21.15.50:6823","nonce":27757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":27757},{"type":"v1","addr":"172.21.15.50:6821","nonce":27757}]},"public_addr":"172.21.15.50:6817/27757","cluster_addr":"172.21.15.50:6819/27757","heartbeat_back_addr":"172.21.15.50:6823/27757","heartbeat_front_addr":"172.21.15.50:6821/27757","state":["exists","up"]},{"osd":1,"uuid":"57d4e31d-408e-4302-859d-7ea672b93772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":27758},{"type":"v1","addr":"172.21.15.50:6801","nonce":27758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":27758},{"type":"v1","addr":"172.21.15.50:6803","nonce":27758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":27758},{"type":"v1","addr":"172.21.15.50:6810","nonce":27758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6805","nonce":27758},{"type":"v1","addr":"172.21.15.50:6807","nonce":27758}]},"public_addr":"172.21.15.50:6801/27758","cluster_addr":"172.21.15.50:6803/27758","heartbeat_back_addr":"172.21.15.50:6810/27758","heartbeat_front_addr":"172.21.15.50:6807/27758","state":["exists","up"]},{"osd":2,"uuid":"600ea585-aa50-4596-9b14-090eab15f9a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":27759},{"type":"v1","addr":"172.21.15.50:6806","nonce":27759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":27759},{"type":"v1","addr":"172.21.15.50:6811","nonce":27759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":27759},{"type":"v1","addr":"172.21.15.50:6816","nonce":27759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":27759},{"type":"v1","addr":"172.21.15.50:6813","nonce":27759}]},"public_addr":"172.21.15.50:6806/27759","cluster_addr":"172.21.15.50:6811/27759","heartbeat_back_addr":"172.21.15.50:6816/27759","heartbeat_front_addr":"172.21.15.50:6813/27759","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-19T22:07:56.415731+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-19T22:07:56.346062+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-19T22:07:56.090889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-19T22:08:07.264 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.261+0000 7fe7dd9d7700 1 -- 172.21.15.50:0/3985704559 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fe7bc020020 msgr2=0x7fe7bc022530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:07.264 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.261+0000 7fe7dd9d7700 1 --2- 172.21.15.50:0/3985704559 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fe7bc020020 0x7fe7bc022530 crc :-1 s=READY pgs=19 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:07.264 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.261+0000 7fe7dd9d7700 1 -- 172.21.15.50:0/3985704559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7d8077390 msgr2=0x7fe7d80777c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:07.264 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.261+0000 7fe7dd9d7700 1 --2- 172.21.15.50:0/3985704559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7d8077390 0x7fe7d80777c0 secure :-1 s=READY pgs=81 cs=0 l=1 rx=0x7fe7c8001430 tx=0x7fe7c80108f0).stop 2019-12-19T22:08:07.264 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.261+0000 7fe7dd9d7700 1 -- 172.21.15.50:0/3985704559 shutdown_connections 2019-12-19T22:08:07.265 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.261+0000 7fe7dd9d7700 1 --2- 172.21.15.50:0/3985704559 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fe7bc020020 0x7fe7bc022530 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:07.265 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.261+0000 7fe7dd9d7700 1 --2- 172.21.15.50:0/3985704559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe7d8077390 0x7fe7d80777c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:07.265 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.261+0000 7fe7dd9d7700 1 -- 172.21.15.50:0/3985704559 shutdown_connections 2019-12-19T22:08:07.265 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.261+0000 7fe7dd9d7700 1 -- 172.21.15.50:0/3985704559 wait complete. 2019-12-19T22:08:07.265 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.261+0000 7fe7dd9d7700 1 -- 172.21.15.50:0/3985704559 >> 172.21.15.50:0/3985704559 conn(0x7fe7d8091150 msgr2=0x7fe7d807ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:07.275 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2019-12-19T22:08:07.399 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.389+0000 7f6c16c2a700 1 Processor -- start 2019-12-19T22:08:07.399 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.389+0000 7f6c16c2a700 1 -- start start 2019-12-19T22:08:07.399 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.389+0000 7f6c16c2a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6c1007dac0 0x7f6c1008eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:07.399 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.389+0000 7f6c16c2a700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c1008fd30 con 0x7f6c10089510 2019-12-19T22:08:07.399 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.389+0000 7f6c16c2a700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c1008f8f0 con 0x7f6c1007dac0 2019-12-19T22:08:07.404 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.389+0000 7f6c151c7700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6c1007dac0 0x7f6c1008eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:07.404 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.389+0000 7f6c149c6700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6c10089510 0x7f6c1007e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39654/0 (socket says 172.21.15.50:39654) 2019-12-19T22:08:07.404 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.389+0000 7f6c149c6700 1 -- 172.21.15.50:0/2535133689 learned_addr learned my addr 172.21.15.50:0/2535133689 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:07.404 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.390+0000 7f6c151c7700 1 -- 172.21.15.50:0/2535133689 >> v1:172.21.15.50:6789/0 conn(0x7f6c10089510 legacy=0x7f6c1007e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:07.405 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.390+0000 7f6c07fff700 1 -- 172.21.15.50:0/2535133689 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1896725343 0 0) 0x7f6c1008fd30 con 0x7f6c10089510 2019-12-19T22:08:07.405 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.390+0000 7f6c151c7700 1 -- 172.21.15.50:0/2535133689 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c1008de50 con 0x7f6c1007dac0 2019-12-19T22:08:07.405 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.390+0000 7f6c151c7700 1 --2- 172.21.15.50:0/2535133689 >> v2:172.21.15.50:3300/0 conn(0x7f6c1007dac0 0x7f6c1008eb70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6c0c008790 tx=0x7f6c0c00fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:07.405 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.390+0000 7f6c151c7700 1 --2- 172.21.15.50:0/2535133689 >> v2:172.21.15.50:3300/0 conn(0x7f6c1007dac0 0x7f6c1008eb70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6c0c008790 tx=0x7f6c0c00fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:07.405 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.390+0000 7f6c151c7700 1 --2- 172.21.15.50:0/2535133689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c1007dac0 0x7f6c1008eb70 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7f6c0c008790 tx=0x7f6c0c00fbf0).ready entity=mon.0 client_cookie=9cea05441c59ffcd server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:07.406 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.390+0000 7f6c151c7700 1 --2- 172.21.15.50:0/2535133689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c1007dac0 0x7f6c1008eb70 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f6c0c008790 tx=0x7f6c0c00fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:07.406 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.390+0000 7f6c07fff700 1 -- 172.21.15.50:0/2535133689 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f6c0c011230 con 0x7f6c1007dac0 2019-12-19T22:08:07.406 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.390+0000 7f6c151c7700 1 --2- 172.21.15.50:0/2535133689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c1007dac0 0x7f6c1008eb70 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f6c0c008790 tx=0x7f6c0c00fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:07.406 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.390+0000 7f6c151c7700 1 --2- 172.21.15.50:0/2535133689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c1007dac0 0x7f6c1008eb70 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f6c0c008790 tx=0x7f6c0c00fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:07.406 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.390+0000 7f6c07fff700 1 -- 172.21.15.50:0/2535133689 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c0c011430 con 0x7f6c1007dac0 2019-12-19T22:08:07.407 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.390+0000 7f6c07fff700 1 -- 172.21.15.50:0/2535133689 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f6c0c011750 con 0x7f6c1007dac0 2019-12-19T22:08:07.407 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.390+0000 7f6c16c2a700 1 -- 172.21.15.50:0/2535133689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c1007dac0 msgr2=0x7f6c1008eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:07.407 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.390+0000 7f6c16c2a700 1 --2- 172.21.15.50:0/2535133689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c1007dac0 0x7f6c1008eb70 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7f6c0c008790 tx=0x7f6c0c00fbf0).stop 2019-12-19T22:08:07.407 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.390+0000 7f6c16c2a700 1 -- 172.21.15.50:0/2535133689 shutdown_connections 2019-12-19T22:08:07.407 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.390+0000 7f6c16c2a700 1 --2- 172.21.15.50:0/2535133689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c1007dac0 0x7f6c1008eb70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:07.409 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.391+0000 7f6c16c2a700 1 -- 172.21.15.50:0/2535133689 shutdown_connections 2019-12-19T22:08:07.409 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.391+0000 7f6c16c2a700 1 -- 172.21.15.50:0/2535133689 wait complete. 2019-12-19T22:08:07.409 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.391+0000 7f6c16c2a700 1 -- 172.21.15.50:0/2535133689 >> 172.21.15.50:0/2535133689 conn(0x7f6c10092f20 msgr2=0x7f6c1008b240 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:07.410 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.391+0000 7f6c16c2a700 1 Processor -- start 2019-12-19T22:08:07.417 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.392+0000 7f6c16c2a700 1 -- start start 2019-12-19T22:08:07.418 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.392+0000 7f6c16c2a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6c10065d80 0x7f6c100866a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:07.418 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.392+0000 7f6c16c2a700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c10089380 con 0x7f6c100661b0 2019-12-19T22:08:07.418 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.392+0000 7f6c16c2a700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c10088900 con 0x7f6c10065d80 2019-12-19T22:08:07.418 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.392+0000 7f6c151c7700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6c10065d80 0x7f6c100866a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:07.419 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.392+0000 7f6c151c7700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6c10065d80 0x7f6c100866a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53528/0 (socket says 172.21.15.50:53528) 2019-12-19T22:08:07.419 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.392+0000 7f6c151c7700 1 -- 172.21.15.50:0/3377282295 learned_addr learned my addr 172.21.15.50:0/3377282295 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:07.419 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.392+0000 7f6c151c7700 1 -- 172.21.15.50:0/3377282295 >> v1:172.21.15.50:6789/0 conn(0x7f6c100661b0 legacy=0x7f6c10086bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:07.419 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.392+0000 7f6c151c7700 1 -- 172.21.15.50:0/3377282295 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c10089d80 con 0x7f6c10065d80 2019-12-19T22:08:07.419 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.393+0000 7f6c151c7700 1 --2- 172.21.15.50:0/3377282295 >> v2:172.21.15.50:3300/0 conn(0x7f6c10065d80 0x7f6c100866a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6c0c008790 tx=0x7f6c0c011730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:07.420 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.393+0000 7f6c151c7700 1 --2- 172.21.15.50:0/3377282295 >> v2:172.21.15.50:3300/0 conn(0x7f6c10065d80 0x7f6c100866a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6c0c008790 tx=0x7f6c0c011730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:07.420 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.393+0000 7f6c151c7700 1 --2- 172.21.15.50:0/3377282295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c10065d80 0x7f6c100866a0 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7f6c0c008790 tx=0x7f6c0c011730).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:07.420 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.393+0000 7f6c151c7700 1 --2- 172.21.15.50:0/3377282295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c10065d80 0x7f6c100866a0 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f6c0c008790 tx=0x7f6c0c011730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:07.420 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.393+0000 7f6c151c7700 1 --2- 172.21.15.50:0/3377282295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c10065d80 0x7f6c100866a0 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f6c0c008790 tx=0x7f6c0c011730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:07.421 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.393+0000 7f6c05ffb700 1 -- 172.21.15.50:0/3377282295 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f6c0c011bc0 con 0x7f6c10065d80 2019-12-19T22:08:07.421 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.393+0000 7f6c151c7700 1 --2- 172.21.15.50:0/3377282295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c10065d80 0x7f6c100866a0 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f6c0c008790 tx=0x7f6c0c011730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:07.421 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.393+0000 7f6c05ffb700 1 -- 172.21.15.50:0/3377282295 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c0c011dc0 con 0x7f6c10065d80 2019-12-19T22:08:07.421 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.393+0000 7f6c16c2a700 1 -- 172.21.15.50:0/3377282295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c10088f90 con 0x7f6c10065d80 2019-12-19T22:08:07.421 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.393+0000 7f6c05ffb700 1 -- 172.21.15.50:0/3377282295 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f6c0c005670 con 0x7f6c10065d80 2019-12-19T22:08:07.421 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.393+0000 7f6c16c2a700 1 -- 172.21.15.50:0/3377282295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c100873f0 con 0x7f6c10065d80 2019-12-19T22:08:07.421 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.393+0000 7f6c151c7700 1 --2- 172.21.15.50:0/3377282295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c10065d80 0x7f6c100866a0 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f6c0c008790 tx=0x7f6c0c011730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:07.422 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.393+0000 7f6c05ffb700 1 -- 172.21.15.50:0/3377282295 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7f6c0c005870 con 0x7f6c10065d80 2019-12-19T22:08:07.422 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.393+0000 7f6c151c7700 1 --2- 172.21.15.50:0/3377282295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c10065d80 0x7f6c100866a0 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f6c0c008790 tx=0x7f6c0c011730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:07.422 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.393+0000 7f6c05ffb700 1 --2- 172.21.15.50:0/3377282295 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f6bf001fa80 0x7f6bf0021f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:07.422 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.393+0000 7f6c05ffb700 1 -- 172.21.15.50:0/3377282295 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3403+0+0 (secure 0 0 0) 0x7f6c0c02aee0 con 0x7f6c10065d80 2019-12-19T22:08:07.422 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.394+0000 7f6c149c6700 1 --2- 172.21.15.50:0/3377282295 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f6bf001fa80 0x7f6bf0021f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:07.422 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.394+0000 7f6c149c6700 1 --2- 172.21.15.50:0/3377282295 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f6bf001fa80 0x7f6bf0021f90 crc :-1 s=READY pgs=20 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:07.422 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.394+0000 7f6c16c2a700 1 -- 172.21.15.50:0/3377282295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c10056340 con 0x7f6c10065d80 2019-12-19T22:08:07.423 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.397+0000 7f6c151c7700 1 --2- 172.21.15.50:0/3377282295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c10065d80 0x7f6c100866a0 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f6c0c008790 tx=0x7f6c0c011730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:07.423 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.397+0000 7f6c05ffb700 1 -- 172.21.15.50:0/3377282295 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7f6c0c047e90 con 0x7f6c10065d80 2019-12-19T22:08:07.581 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:07.579+0000 7f6c16c2a700 1 -- 172.21.15.50:0/3377282295 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f6c1007da30 con 0x7f6c10065d80 2019-12-19T22:08:08.380 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.378+0000 7f6c151c7700 1 --2- 172.21.15.50:0/3377282295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c10065d80 0x7f6c100866a0 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f6c0c008790 tx=0x7f6c0c011730).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:08.382 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.378+0000 7f6c05ffb700 1 -- 172.21.15.50:0/3377282295 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v3) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6c0c014470 con 0x7f6c10065d80 2019-12-19T22:08:08.383 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.380+0000 7f6c16c2a700 1 -- 172.21.15.50:0/3377282295 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f6bf001fa80 msgr2=0x7f6bf0021f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:08.383 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.380+0000 7f6c16c2a700 1 --2- 172.21.15.50:0/3377282295 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f6bf001fa80 0x7f6bf0021f90 crc :-1 s=READY pgs=20 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:08.384 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.380+0000 7f6c16c2a700 1 -- 172.21.15.50:0/3377282295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c10065d80 msgr2=0x7f6c100866a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:08.384 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.380+0000 7f6c16c2a700 1 --2- 172.21.15.50:0/3377282295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c10065d80 0x7f6c100866a0 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7f6c0c008790 tx=0x7f6c0c011730).stop 2019-12-19T22:08:08.384 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.380+0000 7f6c16c2a700 1 -- 172.21.15.50:0/3377282295 shutdown_connections 2019-12-19T22:08:08.384 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.380+0000 7f6c16c2a700 1 --2- 172.21.15.50:0/3377282295 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f6bf001fa80 0x7f6bf0021f90 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:08.384 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.380+0000 7f6c16c2a700 1 --2- 172.21.15.50:0/3377282295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c10065d80 0x7f6c100866a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:08.384 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.380+0000 7f6c16c2a700 1 -- 172.21.15.50:0/3377282295 shutdown_connections 2019-12-19T22:08:08.384 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.380+0000 7f6c16c2a700 1 -- 172.21.15.50:0/3377282295 wait complete. 2019-12-19T22:08:08.385 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.380+0000 7f6c16c2a700 1 -- 172.21.15.50:0/3377282295 >> 172.21.15.50:0/3377282295 conn(0x7f6c1008d6e0 msgr2=0x7f6c10092f20 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:08.395 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-12-19T22:08:08.526 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.513+0000 7f641e13f700 1 Processor -- start 2019-12-19T22:08:08.526 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.513+0000 7f641e13f700 1 -- start start 2019-12-19T22:08:08.526 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.514+0000 7f641e13f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6418089480 0x7f64180898b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:08.527 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.514+0000 7f641e13f700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f641808edb0 con 0x7f641808f3d0 2019-12-19T22:08:08.527 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.514+0000 7f641e13f700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f641808ae60 con 0x7f6418089480 2019-12-19T22:08:08.527 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.514+0000 7f6417fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6418089480 0x7f64180898b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:08.527 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.514+0000 7f640ffff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f641808f3d0 0x7f6418081170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39662/0 (socket says 172.21.15.50:39662) 2019-12-19T22:08:08.527 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.514+0000 7f640ffff700 1 -- 172.21.15.50:0/3629569141 learned_addr learned my addr 172.21.15.50:0/3629569141 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:08.531 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.514+0000 7f6417fff700 1 -- 172.21.15.50:0/3629569141 >> v1:172.21.15.50:6789/0 conn(0x7f641808f3d0 legacy=0x7f6418081170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:08.531 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.514+0000 7f64177fe700 1 -- 172.21.15.50:0/3629569141 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4171679121 0 0) 0x7f641808edb0 con 0x7f641808f3d0 2019-12-19T22:08:08.531 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.514+0000 7f6417fff700 1 -- 172.21.15.50:0/3629569141 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6418081970 con 0x7f6418089480 2019-12-19T22:08:08.531 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.514+0000 7f6417fff700 1 --2- 172.21.15.50:0/3629569141 >> v2:172.21.15.50:3300/0 conn(0x7f6418089480 0x7f64180898b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6408008790 tx=0x7f640800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:08.531 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.514+0000 7f6417fff700 1 --2- 172.21.15.50:0/3629569141 >> v2:172.21.15.50:3300/0 conn(0x7f6418089480 0x7f64180898b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6408008790 tx=0x7f640800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:08.531 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.514+0000 7f6417fff700 1 --2- 172.21.15.50:0/3629569141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6418089480 0x7f64180898b0 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7f6408008790 tx=0x7f640800fbf0).ready entity=mon.0 client_cookie=4793eee8640558ba server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:08.532 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.514+0000 7f6417fff700 1 --2- 172.21.15.50:0/3629569141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6418089480 0x7f64180898b0 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f6408008790 tx=0x7f640800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:08.532 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.514+0000 7f64177fe700 1 -- 172.21.15.50:0/3629569141 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f6408011270 con 0x7f6418089480 2019-12-19T22:08:08.532 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.514+0000 7f6417fff700 1 --2- 172.21.15.50:0/3629569141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6418089480 0x7f64180898b0 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f6408008790 tx=0x7f640800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:08.532 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.514+0000 7f6417fff700 1 --2- 172.21.15.50:0/3629569141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6418089480 0x7f64180898b0 secure :-1 s=THROTTLE_DONE pgs=87 cs=0 l=1 rx=0x7f6408008790 tx=0x7f640800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:08.532 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.514+0000 7f64177fe700 1 -- 172.21.15.50:0/3629569141 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6408011470 con 0x7f6418089480 2019-12-19T22:08:08.532 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.514+0000 7f64177fe700 1 -- 172.21.15.50:0/3629569141 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f6408011790 con 0x7f6418089480 2019-12-19T22:08:08.532 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.514+0000 7f641e13f700 1 -- 172.21.15.50:0/3629569141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6418089480 msgr2=0x7f64180898b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:08.533 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.514+0000 7f641e13f700 1 --2- 172.21.15.50:0/3629569141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6418089480 0x7f64180898b0 secure :-1 s=READY pgs=87 cs=0 l=1 rx=0x7f6408008790 tx=0x7f640800fbf0).stop 2019-12-19T22:08:08.533 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.515+0000 7f641e13f700 1 -- 172.21.15.50:0/3629569141 shutdown_connections 2019-12-19T22:08:08.533 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.515+0000 7f641e13f700 1 --2- 172.21.15.50:0/3629569141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6418089480 0x7f64180898b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:08.533 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.515+0000 7f641e13f700 1 -- 172.21.15.50:0/3629569141 shutdown_connections 2019-12-19T22:08:08.533 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.515+0000 7f641e13f700 1 -- 172.21.15.50:0/3629569141 wait complete. 2019-12-19T22:08:08.533 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.515+0000 7f641e13f700 1 -- 172.21.15.50:0/3629569141 >> 172.21.15.50:0/3629569141 conn(0x7f6418067e70 msgr2=0x7f6418094570 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:08.539 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.516+0000 7f641e13f700 1 Processor -- start 2019-12-19T22:08:08.540 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.516+0000 7f641e13f700 1 -- start start 2019-12-19T22:08:08.540 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.516+0000 7f641e13f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6418124940 0x7f6418126d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:08.540 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.516+0000 7f641e13f700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6418088f70 con 0x7f64180908d0 2019-12-19T22:08:08.540 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.516+0000 7f641e13f700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6418082200 con 0x7f6418124940 2019-12-19T22:08:08.540 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.516+0000 7f6417fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f64180908d0 0x7f6418090d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39666/0 (socket says 172.21.15.50:39666) 2019-12-19T22:08:08.540 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.516+0000 7f6417fff700 1 -- 172.21.15.50:0/1986889946 learned_addr learned my addr 172.21.15.50:0/1986889946 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:08.541 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.516+0000 7f640ffff700 1 --2- 172.21.15.50:0/1986889946 >> v2:172.21.15.50:3300/0 conn(0x7f6418124940 0x7f6418126d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:08.541 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.517+0000 7f64157fa700 1 -- 172.21.15.50:0/1986889946 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1357678894 0 0) 0x7f6418088f70 con 0x7f64180908d0 2019-12-19T22:08:08.541 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.517+0000 7f64157fa700 1 -- 172.21.15.50:0/1986889946 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63fc0030b0 con 0x7f64180908d0 2019-12-19T22:08:08.541 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.517+0000 7f640ffff700 1 -- 172.21.15.50:0/1986889946 >> v1:172.21.15.50:6789/0 conn(0x7f64180908d0 legacy=0x7f6418090d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:08.541 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.517+0000 7f640ffff700 1 -- 172.21.15.50:0/1986889946 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64180874f0 con 0x7f6418124940 2019-12-19T22:08:08.541 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.517+0000 7f640ffff700 1 --2- 172.21.15.50:0/1986889946 >> v2:172.21.15.50:3300/0 conn(0x7f6418124940 0x7f6418126d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f64000043a0 tx=0x7f6400010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:08.541 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.517+0000 7f640ffff700 1 --2- 172.21.15.50:0/1986889946 >> v2:172.21.15.50:3300/0 conn(0x7f6418124940 0x7f6418126d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f64000043a0 tx=0x7f6400010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:08.542 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.517+0000 7f640ffff700 1 --2- 172.21.15.50:0/1986889946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6418124940 0x7f6418126d80 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7f64000043a0 tx=0x7f6400010820).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:08.542 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.517+0000 7f640ffff700 1 --2- 172.21.15.50:0/1986889946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6418124940 0x7f6418126d80 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f64000043a0 tx=0x7f6400010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:08.542 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.517+0000 7f64157fa700 1 -- 172.21.15.50:0/1986889946 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f64000114c0 con 0x7f6418124940 2019-12-19T22:08:08.542 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.517+0000 7f640ffff700 1 --2- 172.21.15.50:0/1986889946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6418124940 0x7f6418126d80 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f64000043a0 tx=0x7f6400010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:08.542 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.517+0000 7f640ffff700 1 --2- 172.21.15.50:0/1986889946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6418124940 0x7f6418126d80 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f64000043a0 tx=0x7f6400010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:08.542 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.517+0000 7f64157fa700 1 -- 172.21.15.50:0/1986889946 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64000116c0 con 0x7f6418124940 2019-12-19T22:08:08.543 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.517+0000 7f641e13f700 1 -- 172.21.15.50:0/1986889946 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64180869b0 con 0x7f6418124940 2019-12-19T22:08:08.543 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.517+0000 7f64157fa700 1 -- 172.21.15.50:0/1986889946 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f64000119e0 con 0x7f6418124940 2019-12-19T22:08:08.543 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.517+0000 7f641e13f700 1 -- 172.21.15.50:0/1986889946 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6418088c60 con 0x7f6418124940 2019-12-19T22:08:08.543 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.517+0000 7f640ffff700 1 --2- 172.21.15.50:0/1986889946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6418124940 0x7f6418126d80 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f64000043a0 tx=0x7f6400010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:08.543 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.518+0000 7f64157fa700 1 -- 172.21.15.50:0/1986889946 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7f640000b330 con 0x7f6418124940 2019-12-19T22:08:08.543 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.518+0000 7f640ffff700 1 --2- 172.21.15.50:0/1986889946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6418124940 0x7f6418126d80 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f64000043a0 tx=0x7f6400010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:08.543 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.518+0000 7f64157fa700 1 --2- 172.21.15.50:0/1986889946 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f63fc020040 0x7f63fc022550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:08.544 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.518+0000 7f64157fa700 1 -- 172.21.15.50:0/1986889946 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3403+0+0 (secure 0 0 0) 0x7f640002a3e0 con 0x7f6418124940 2019-12-19T22:08:08.544 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.518+0000 7f6417fff700 1 --2- 172.21.15.50:0/1986889946 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f63fc020040 0x7f63fc022550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:08.544 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.518+0000 7f641e13f700 1 -- 172.21.15.50:0/1986889946 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6418056340 con 0x7f6418124940 2019-12-19T22:08:08.544 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.518+0000 7f6417fff700 1 --2- 172.21.15.50:0/1986889946 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f63fc020040 0x7f63fc022550 crc :-1 s=READY pgs=21 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:08.544 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.521+0000 7f640ffff700 1 --2- 172.21.15.50:0/1986889946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6418124940 0x7f6418126d80 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f64000043a0 tx=0x7f6400010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:08.544 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.521+0000 7f64157fa700 1 -- 172.21.15.50:0/1986889946 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7f64180869b0 con 0x7f6418124940 2019-12-19T22:08:08.704 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.699+0000 7f641e13f700 1 -- 172.21.15.50:0/1986889946 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6418088020 con 0x7f6418124940 2019-12-19T22:08:08.704 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.700+0000 7f640ffff700 1 --2- 172.21.15.50:0/1986889946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6418124940 0x7f6418126d80 secure :-1 s=THROTTLE_DONE pgs=89 cs=0 l=1 rx=0x7f64000043a0 tx=0x7f6400010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:08.704 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.700+0000 7f64157fa700 1 -- 172.21.15.50:0/1986889946 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+1420 (secure 0 0 0) 0x7f6400005dd0 con 0x7f6418124940 2019-12-19T22:08:08.704 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.701+0000 7f641e13f700 1 -- 172.21.15.50:0/1986889946 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f63fc020040 msgr2=0x7f63fc022550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:08.704 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.701+0000 7f641e13f700 1 --2- 172.21.15.50:0/1986889946 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f63fc020040 0x7f63fc022550 crc :-1 s=READY pgs=21 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:08.705 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.701+0000 7f641e13f700 1 -- 172.21.15.50:0/1986889946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6418124940 msgr2=0x7f6418126d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:08.705 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.701+0000 7f641e13f700 1 --2- 172.21.15.50:0/1986889946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6418124940 0x7f6418126d80 secure :-1 s=READY pgs=89 cs=0 l=1 rx=0x7f64000043a0 tx=0x7f6400010820).stop 2019-12-19T22:08:08.705 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.701+0000 7f641e13f700 1 -- 172.21.15.50:0/1986889946 shutdown_connections 2019-12-19T22:08:08.705 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.701+0000 7f641e13f700 1 --2- 172.21.15.50:0/1986889946 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f63fc020040 0x7f63fc022550 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:08.705 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.701+0000 7f641e13f700 1 --2- 172.21.15.50:0/1986889946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6418124940 0x7f6418126d80 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:08.705 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.701+0000 7f641e13f700 1 -- 172.21.15.50:0/1986889946 shutdown_connections 2019-12-19T22:08:08.705 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.701+0000 7f641e13f700 1 -- 172.21.15.50:0/1986889946 wait complete. 2019-12-19T22:08:08.706 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.701+0000 7f641e13f700 1 -- 172.21.15.50:0/1986889946 >> 172.21.15.50:0/1986889946 conn(0x7f6418081c40 msgr2=0x7f641808b880 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:08.706 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 3 2019-12-19T22:08:08.706 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:08:08.706 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":3,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":3,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-12-19T22:08:06.710606+0000","modified":"2019-12-19T22:08:08.376690+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2019-12-19T22:08:08.713 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-12-19T22:08:08.833 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.825+0000 7f964f1a6700 1 Processor -- start 2019-12-19T22:08:08.834 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.825+0000 7f964f1a6700 1 -- start start 2019-12-19T22:08:08.834 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.826+0000 7f964f1a6700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f964807d340 0x7f9648074f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:08.834 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.826+0000 7f964f1a6700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9648064060 con 0x7f964807cf10 2019-12-19T22:08:08.834 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.826+0000 7f964f1a6700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f964808ae60 con 0x7f964807d340 2019-12-19T22:08:08.835 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.826+0000 7f964e1a4700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f964807d340 0x7f9648074f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:08.836 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.826+0000 7f964e9a5700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f964807cf10 0x7f9648063680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39672/0 (socket says 172.21.15.50:39672) 2019-12-19T22:08:08.839 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.826+0000 7f964e9a5700 1 -- 172.21.15.50:0/3337938016 learned_addr learned my addr 172.21.15.50:0/3337938016 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:08.839 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.826+0000 7f964e1a4700 1 -- 172.21.15.50:0/3337938016 >> v1:172.21.15.50:6789/0 conn(0x7f964807cf10 legacy=0x7f9648063680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:08.839 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.826+0000 7f964e1a4700 1 -- 172.21.15.50:0/3337938016 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f964807c650 con 0x7f964807d340 2019-12-19T22:08:08.839 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.826+0000 7f964e1a4700 1 --2- 172.21.15.50:0/3337938016 >> v2:172.21.15.50:3300/0 conn(0x7f964807d340 0x7f9648074f50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9638008790 tx=0x7f963800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.827+0000 7f964e1a4700 1 --2- 172.21.15.50:0/3337938016 >> v2:172.21.15.50:3300/0 conn(0x7f964807d340 0x7f9648074f50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9638008790 tx=0x7f963800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.827+0000 7f964e1a4700 1 --2- 172.21.15.50:0/3337938016 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f964807d340 0x7f9648074f50 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7f9638008790 tx=0x7f963800fbf0).ready entity=mon.0 client_cookie=9da0e868677314f0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.827+0000 7f964e1a4700 1 --2- 172.21.15.50:0/3337938016 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f964807d340 0x7f9648074f50 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f9638008790 tx=0x7f963800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.827+0000 7f964d9a3700 1 -- 172.21.15.50:0/3337938016 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f9638011270 con 0x7f964807d340 2019-12-19T22:08:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.827+0000 7f964e1a4700 1 --2- 172.21.15.50:0/3337938016 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f964807d340 0x7f9648074f50 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f9638008790 tx=0x7f963800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:08.840 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.827+0000 7f964e1a4700 1 --2- 172.21.15.50:0/3337938016 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f964807d340 0x7f9648074f50 secure :-1 s=THROTTLE_DONE pgs=91 cs=0 l=1 rx=0x7f9638008790 tx=0x7f963800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:08.841 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.827+0000 7f964d9a3700 1 -- 172.21.15.50:0/3337938016 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9638011470 con 0x7f964807d340 2019-12-19T22:08:08.841 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.827+0000 7f964d9a3700 1 -- 172.21.15.50:0/3337938016 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f9638011790 con 0x7f964807d340 2019-12-19T22:08:08.841 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.827+0000 7f964f1a6700 1 -- 172.21.15.50:0/3337938016 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f964807d340 msgr2=0x7f9648074f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:08.841 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.827+0000 7f964f1a6700 1 --2- 172.21.15.50:0/3337938016 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f964807d340 0x7f9648074f50 secure :-1 s=READY pgs=91 cs=0 l=1 rx=0x7f9638008790 tx=0x7f963800fbf0).stop 2019-12-19T22:08:08.841 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.827+0000 7f964f1a6700 1 -- 172.21.15.50:0/3337938016 shutdown_connections 2019-12-19T22:08:08.841 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.827+0000 7f964f1a6700 1 --2- 172.21.15.50:0/3337938016 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f964807d340 0x7f9648074f50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:08.841 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.827+0000 7f964f1a6700 1 -- 172.21.15.50:0/3337938016 shutdown_connections 2019-12-19T22:08:08.842 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.827+0000 7f964f1a6700 1 -- 172.21.15.50:0/3337938016 wait complete. 2019-12-19T22:08:08.842 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.827+0000 7f964f1a6700 1 -- 172.21.15.50:0/3337938016 >> 172.21.15.50:0/3337938016 conn(0x7f9648095890 msgr2=0x7f9648095cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:08.842 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.828+0000 7f964f1a6700 1 Processor -- start 2019-12-19T22:08:08.842 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.828+0000 7f964f1a6700 1 -- start start 2019-12-19T22:08:08.842 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.829+0000 7f964f1a6700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9648121a70 0x7f9648123eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:08.842 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.829+0000 7f964f1a6700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f964808f840 con 0x7f96480784d0 2019-12-19T22:08:08.842 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.829+0000 7f964f1a6700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f964808d8a0 con 0x7f9648121a70 2019-12-19T22:08:08.843 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.829+0000 7f964e1a4700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9648121a70 0x7f9648123eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:08.843 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.829+0000 7f964e1a4700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9648121a70 0x7f9648123eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53550/0 (socket says 172.21.15.50:53550) 2019-12-19T22:08:08.843 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.829+0000 7f964e1a4700 1 -- 172.21.15.50:0/4053158 learned_addr learned my addr 172.21.15.50:0/4053158 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:08.843 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.829+0000 7f964e9a5700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f96480784d0 0x7f9648078900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39676/0 (socket says 172.21.15.50:39676) 2019-12-19T22:08:08.843 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.829+0000 7f964e1a4700 1 -- 172.21.15.50:0/4053158 >> v1:172.21.15.50:6789/0 conn(0x7f96480784d0 legacy=0x7f9648078900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:08.843 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.829+0000 7f964e1a4700 1 -- 172.21.15.50:0/4053158 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f964808e940 con 0x7f9648121a70 2019-12-19T22:08:08.843 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.829+0000 7f963f7fe700 1 -- 172.21.15.50:0/4053158 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1185483628 0 0) 0x7f964808f840 con 0x7f96480784d0 2019-12-19T22:08:08.844 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.829+0000 7f964e1a4700 1 --2- 172.21.15.50:0/4053158 >> v2:172.21.15.50:3300/0 conn(0x7f9648121a70 0x7f9648123eb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9638008790 tx=0x7f963800f510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:08.844 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.829+0000 7f964e1a4700 1 --2- 172.21.15.50:0/4053158 >> v2:172.21.15.50:3300/0 conn(0x7f9648121a70 0x7f9648123eb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9638008790 tx=0x7f963800f510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:08.844 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.829+0000 7f964e1a4700 1 --2- 172.21.15.50:0/4053158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9648121a70 0x7f9648123eb0 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7f9638008790 tx=0x7f963800f510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:08.844 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.829+0000 7f964e1a4700 1 --2- 172.21.15.50:0/4053158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9648121a70 0x7f9648123eb0 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f9638008790 tx=0x7f963800f510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:08.856 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.829+0000 7f963f7fe700 1 -- 172.21.15.50:0/4053158 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f9638007150 con 0x7f9648121a70 2019-12-19T22:08:08.856 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.829+0000 7f964e1a4700 1 --2- 172.21.15.50:0/4053158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9648121a70 0x7f9648123eb0 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f9638008790 tx=0x7f963800f510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:08.857 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.829+0000 7f963f7fe700 1 -- 172.21.15.50:0/4053158 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9638007350 con 0x7f9648121a70 2019-12-19T22:08:08.857 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.829+0000 7f964f1a6700 1 -- 172.21.15.50:0/4053158 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f964808e030 con 0x7f9648121a70 2019-12-19T22:08:08.857 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.829+0000 7f964e1a4700 1 --2- 172.21.15.50:0/4053158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9648121a70 0x7f9648123eb0 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f9638008790 tx=0x7f963800f510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:08.857 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.829+0000 7f963f7fe700 1 -- 172.21.15.50:0/4053158 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f96380115b0 con 0x7f9648121a70 2019-12-19T22:08:08.857 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.829+0000 7f964f1a6700 1 -- 172.21.15.50:0/4053158 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9648080730 con 0x7f9648121a70 2019-12-19T22:08:08.857 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.830+0000 7f964e1a4700 1 --2- 172.21.15.50:0/4053158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9648121a70 0x7f9648123eb0 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f9638008790 tx=0x7f963800f510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:08.858 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.830+0000 7f963f7fe700 1 -- 172.21.15.50:0/4053158 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7f9638005540 con 0x7f9648121a70 2019-12-19T22:08:08.858 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.830+0000 7f964e1a4700 1 --2- 172.21.15.50:0/4053158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9648121a70 0x7f9648123eb0 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f9638008790 tx=0x7f963800f510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:08.858 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.830+0000 7f963f7fe700 1 --2- 172.21.15.50:0/4053158 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f9630021c00 0x7f9630024110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:08.858 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.830+0000 7f963f7fe700 1 -- 172.21.15.50:0/4053158 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3403+0+0 (secure 0 0 0) 0x7f963802ac10 con 0x7f9648121a70 2019-12-19T22:08:08.858 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.830+0000 7f964e9a5700 1 --2- 172.21.15.50:0/4053158 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f9630021c00 0x7f9630024110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:08.858 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.830+0000 7f964e9a5700 1 --2- 172.21.15.50:0/4053158 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f9630021c00 0x7f9630024110 crc :-1 s=READY pgs=22 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:08.858 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.830+0000 7f964f1a6700 1 -- 172.21.15.50:0/4053158 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f964808f060 con 0x7f9648121a70 2019-12-19T22:08:08.859 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.834+0000 7f964e1a4700 1 --2- 172.21.15.50:0/4053158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9648121a70 0x7f9648123eb0 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f9638008790 tx=0x7f963800f510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:08.859 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.834+0000 7f963f7fe700 1 -- 172.21.15.50:0/4053158 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7f963802a6f0 con 0x7f9648121a70 2019-12-19T22:08:08.978 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.972+0000 7f964f1a6700 1 -- 172.21.15.50:0/4053158 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9648056340 con 0x7f9648121a70 2019-12-19T22:08:08.978 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.973+0000 7f964e1a4700 1 --2- 172.21.15.50:0/4053158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9648121a70 0x7f9648123eb0 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rx=0x7f9638008790 tx=0x7f963800f510).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:08.978 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.973+0000 7f963f7fe700 1 -- 172.21.15.50:0/4053158 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+8801 (secure 0 0 0) 0x7f96380099b0 con 0x7f9648121a70 2019-12-19T22:08:08.978 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.974+0000 7f964f1a6700 1 -- 172.21.15.50:0/4053158 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f9630021c00 msgr2=0x7f9630024110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:08.978 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.974+0000 7f964f1a6700 1 --2- 172.21.15.50:0/4053158 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f9630021c00 0x7f9630024110 crc :-1 s=READY pgs=22 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:08.979 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.974+0000 7f964f1a6700 1 -- 172.21.15.50:0/4053158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9648121a70 msgr2=0x7f9648123eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:08.979 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.974+0000 7f964f1a6700 1 --2- 172.21.15.50:0/4053158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9648121a70 0x7f9648123eb0 secure :-1 s=READY pgs=93 cs=0 l=1 rx=0x7f9638008790 tx=0x7f963800f510).stop 2019-12-19T22:08:08.979 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.974+0000 7f964f1a6700 1 -- 172.21.15.50:0/4053158 shutdown_connections 2019-12-19T22:08:08.979 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.974+0000 7f964f1a6700 1 --2- 172.21.15.50:0/4053158 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f9630021c00 0x7f9630024110 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:08.979 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.974+0000 7f964f1a6700 1 --2- 172.21.15.50:0/4053158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9648121a70 0x7f9648123eb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:08.979 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.974+0000 7f964f1a6700 1 -- 172.21.15.50:0/4053158 shutdown_connections 2019-12-19T22:08:08.980 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.974+0000 7f964f1a6700 1 -- 172.21.15.50:0/4053158 wait complete. 2019-12-19T22:08:08.980 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:08.974+0000 7f964f1a6700 1 -- 172.21.15.50:0/4053158 >> 172.21.15.50:0/4053158 conn(0x7f96480635b0 msgr2=0x7f9648065160 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:08.980 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:08:08.980 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":17,"fsid":"c1382993-41cc-4b35-a402-c17778701f01","created":"2019-12-19T22:07:52.345475+0000","modified":"2019-12-19T22:08:07.711207+0000","last_up_change":"2019-12-19T22:07:58.357117+0000","last_in_change":"2019-12-19T22:07:58.357117+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-19T22:08:01.570202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2019-12-19T22:08:04.515784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2019-12-19T22:08:05.689151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6137ed8c-8e2c-4e88-8634-dc763bed14c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":27757},{"type":"v1","addr":"172.21.15.50:6817","nonce":27757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":27757},{"type":"v1","addr":"172.21.15.50:6819","nonce":27757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":27757},{"type":"v1","addr":"172.21.15.50:6823","nonce":27757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":27757},{"type":"v1","addr":"172.21.15.50:6821","nonce":27757}]},"public_addr":"172.21.15.50:6817/27757","cluster_addr":"172.21.15.50:6819/27757","heartbeat_back_addr":"172.21.15.50:6823/27757","heartbeat_front_addr":"172.21.15.50:6821/27757","state":["exists","up"]},{"osd":1,"uuid":"57d4e31d-408e-4302-859d-7ea672b93772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":27758},{"type":"v1","addr":"172.21.15.50:6801","nonce":27758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":27758},{"type":"v1","addr":"172.21.15.50:6803","nonce":27758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":27758},{"type":"v1","addr":"172.21.15.50:6810","nonce":27758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6805","nonce":27758},{"type":"v1","addr":"172.21.15.50:6807","nonce":27758}]},"public_addr":"172.21.15.50:6801/27758","cluster_addr":"172.21.15.50:6803/27758","heartbeat_back_addr":"172.21.15.50:6810/27758","heartbeat_front_addr":"172.21.15.50:6807/27758","state":["exists","up"]},{"osd":2,"uuid":"600ea585-aa50-4596-9b14-090eab15f9a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":27759},{"type":"v1","addr":"172.21.15.50:6806","nonce":27759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":27759},{"type":"v1","addr":"172.21.15.50:6811","nonce":27759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":27759},{"type":"v1","addr":"172.21.15.50:6816","nonce":27759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":27759},{"type":"v1","addr":"172.21.15.50:6813","nonce":27759}]},"public_addr":"172.21.15.50:6806/27759","cluster_addr":"172.21.15.50:6811/27759","heartbeat_back_addr":"172.21.15.50:6816/27759","heartbeat_front_addr":"172.21.15.50:6813/27759","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-19T22:07:56.415731+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-19T22:07:56.346062+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-19T22:07:56.090889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-19T22:08:08.987 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2019-12-19T22:08:08.987 INFO:tasks.ceph.mds.a:Restarting daemon 2019-12-19T22:08:08.987 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2019-12-19T22:08:08.990 INFO:tasks.ceph.mds.a:Started 2019-12-19T22:08:08.990 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-12-19T22:08:08.991 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2019-12-19T22:08:09.071 INFO:tasks.ceph.mds.a.smithi050.stdout:starting mds.a at 2019-12-19T22:08:09.107 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.102+0000 7f7d6fade700 1 Processor -- start 2019-12-19T22:08:09.107 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.102+0000 7f7d6fade700 1 -- start start 2019-12-19T22:08:09.107 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.103+0000 7f7d6fade700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7d68089480 0x7f7d680898b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:09.108 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.103+0000 7f7d6fade700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d6808edb0 con 0x7f7d6808f3d0 2019-12-19T22:08:09.108 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.103+0000 7f7d6fade700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d6808ae60 con 0x7f7d68089480 2019-12-19T22:08:09.108 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.103+0000 7f7d6e07b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7d68089480 0x7f7d680898b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:09.108 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.103+0000 7f7d6e07b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7d68089480 0x7f7d680898b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53562/0 (socket says 172.21.15.50:53562) 2019-12-19T22:08:09.108 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.103+0000 7f7d6e07b700 1 -- 172.21.15.50:0/2485580185 learned_addr learned my addr 172.21.15.50:0/2485580185 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:09.108 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.103+0000 7f7d6e07b700 1 -- 172.21.15.50:0/2485580185 >> v1:172.21.15.50:6789/0 conn(0x7f7d6808f3d0 legacy=0x7f7d68081170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:09.108 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.103+0000 7f7d6e07b700 1 -- 172.21.15.50:0/2485580185 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d68081970 con 0x7f7d68089480 2019-12-19T22:08:09.109 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.103+0000 7f7d6e07b700 1 --2- 172.21.15.50:0/2485580185 >> v2:172.21.15.50:3300/0 conn(0x7f7d68089480 0x7f7d680898b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7d58008790 tx=0x7f7d5800fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.109 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.103+0000 7f7d6e07b700 1 --2- 172.21.15.50:0/2485580185 >> v2:172.21.15.50:3300/0 conn(0x7f7d68089480 0x7f7d680898b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7d58008790 tx=0x7f7d5800fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.109 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.103+0000 7f7d6e07b700 1 --2- 172.21.15.50:0/2485580185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d68089480 0x7f7d680898b0 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7f7d58008790 tx=0x7f7d5800fcb0).ready entity=mon.0 client_cookie=d72260f6479197eb server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:09.109 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.103+0000 7f7d6e07b700 1 --2- 172.21.15.50:0/2485580185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d68089480 0x7f7d680898b0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f7d58008790 tx=0x7f7d5800fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.109 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.103+0000 7f7d6d079700 1 -- 172.21.15.50:0/2485580185 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f7d58011330 con 0x7f7d68089480 2019-12-19T22:08:09.109 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.103+0000 7f7d6e07b700 1 --2- 172.21.15.50:0/2485580185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d68089480 0x7f7d680898b0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f7d58008790 tx=0x7f7d5800fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.109 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.103+0000 7f7d6d079700 1 -- 172.21.15.50:0/2485580185 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d58011530 con 0x7f7d68089480 2019-12-19T22:08:09.110 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.103+0000 7f7d6e07b700 1 --2- 172.21.15.50:0/2485580185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d68089480 0x7f7d680898b0 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rx=0x7f7d58008790 tx=0x7f7d5800fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.110 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.103+0000 7f7d6d079700 1 -- 172.21.15.50:0/2485580185 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f7d58011850 con 0x7f7d68089480 2019-12-19T22:08:09.110 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.103+0000 7f7d6fade700 1 -- 172.21.15.50:0/2485580185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d68089480 msgr2=0x7f7d680898b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:09.110 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.103+0000 7f7d6fade700 1 --2- 172.21.15.50:0/2485580185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d68089480 0x7f7d680898b0 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x7f7d58008790 tx=0x7f7d5800fcb0).stop 2019-12-19T22:08:09.110 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.104+0000 7f7d6fade700 1 -- 172.21.15.50:0/2485580185 shutdown_connections 2019-12-19T22:08:09.110 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.104+0000 7f7d6fade700 1 --2- 172.21.15.50:0/2485580185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d68089480 0x7f7d680898b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:09.110 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.104+0000 7f7d6fade700 1 -- 172.21.15.50:0/2485580185 shutdown_connections 2019-12-19T22:08:09.111 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.104+0000 7f7d6fade700 1 -- 172.21.15.50:0/2485580185 wait complete. 2019-12-19T22:08:09.111 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.104+0000 7f7d6fade700 1 -- 172.21.15.50:0/2485580185 >> 172.21.15.50:0/2485580185 conn(0x7f7d68067e70 msgr2=0x7f7d68094570 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:09.111 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.105+0000 7f7d6fade700 1 Processor -- start 2019-12-19T22:08:09.111 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.105+0000 7f7d6fade700 1 -- start start 2019-12-19T22:08:09.114 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.105+0000 7f7d6fade700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7d6811e6c0 0x7f7d6811eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:09.114 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.105+0000 7f7d6fade700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d68061f20 con 0x7f7d6811f040 2019-12-19T22:08:09.114 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.105+0000 7f7d6fade700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d68061010 con 0x7f7d6811e6c0 2019-12-19T22:08:09.114 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.105+0000 7f7d6e07b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7d6811e6c0 0x7f7d6811eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:09.114 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.105+0000 7f7d6e07b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7d6811e6c0 0x7f7d6811eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53566/0 (socket says 172.21.15.50:53566) 2019-12-19T22:08:09.115 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.105+0000 7f7d6e07b700 1 -- 172.21.15.50:0/465696335 learned_addr learned my addr 172.21.15.50:0/465696335 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:09.115 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.105+0000 7f7d6d87a700 1 --1- 172.21.15.50:0/465696335 >> v1:172.21.15.50:6789/0 conn(0x7f7d6811f040 0x7f7d6805f610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39696/0 (socket says 172.21.15.50:39696) 2019-12-19T22:08:09.115 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.106+0000 7f7d6e07b700 1 -- 172.21.15.50:0/465696335 >> v1:172.21.15.50:6789/0 conn(0x7f7d6811f040 legacy=0x7f7d6805f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:09.115 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.106+0000 7f7d6e07b700 1 -- 172.21.15.50:0/465696335 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d68063100 con 0x7f7d6811e6c0 2019-12-19T22:08:09.115 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.106+0000 7f7d5effd700 1 -- 172.21.15.50:0/465696335 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4242207502 0 0) 0x7f7d68061f20 con 0x7f7d6811f040 2019-12-19T22:08:09.115 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.106+0000 7f7d6e07b700 1 --2- 172.21.15.50:0/465696335 >> v2:172.21.15.50:3300/0 conn(0x7f7d6811e6c0 0x7f7d6811eaf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7d58008790 tx=0x7f7d5800f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.115 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.106+0000 7f7d6e07b700 1 --2- 172.21.15.50:0/465696335 >> v2:172.21.15.50:3300/0 conn(0x7f7d6811e6c0 0x7f7d6811eaf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7d58008790 tx=0x7f7d5800f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.116 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.106+0000 7f7d6e07b700 1 --2- 172.21.15.50:0/465696335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d6811e6c0 0x7f7d6811eaf0 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7f7d58008790 tx=0x7f7d5800f780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:09.119 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.106+0000 7f7d6e07b700 1 --2- 172.21.15.50:0/465696335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d6811e6c0 0x7f7d6811eaf0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f7d58008790 tx=0x7f7d5800f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.119 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.106+0000 7f7d5effd700 1 -- 172.21.15.50:0/465696335 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f7d58007280 con 0x7f7d6811e6c0 2019-12-19T22:08:09.120 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.106+0000 7f7d6e07b700 1 --2- 172.21.15.50:0/465696335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d6811e6c0 0x7f7d6811eaf0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f7d58008790 tx=0x7f7d5800f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.120 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.106+0000 7f7d6e07b700 1 --2- 172.21.15.50:0/465696335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d6811e6c0 0x7f7d6811eaf0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f7d58008790 tx=0x7f7d5800f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.120 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.106+0000 7f7d5effd700 1 -- 172.21.15.50:0/465696335 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d58011640 con 0x7f7d6811e6c0 2019-12-19T22:08:09.120 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.106+0000 7f7d6fade700 1 -- 172.21.15.50:0/465696335 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d6811f470 con 0x7f7d6811e6c0 2019-12-19T22:08:09.120 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.106+0000 7f7d5effd700 1 -- 172.21.15.50:0/465696335 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f7d58005540 con 0x7f7d6811e6c0 2019-12-19T22:08:09.120 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.106+0000 7f7d6fade700 1 -- 172.21.15.50:0/465696335 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d680664a0 con 0x7f7d6811e6c0 2019-12-19T22:08:09.121 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.106+0000 7f7d6e07b700 1 --2- 172.21.15.50:0/465696335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d6811e6c0 0x7f7d6811eaf0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f7d58008790 tx=0x7f7d5800f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.121 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.106+0000 7f7d5effd700 1 -- 172.21.15.50:0/465696335 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7f7d58005740 con 0x7f7d6811e6c0 2019-12-19T22:08:09.121 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.106+0000 7f7d6e07b700 1 --2- 172.21.15.50:0/465696335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d6811e6c0 0x7f7d6811eaf0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f7d58008790 tx=0x7f7d5800f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.121 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.107+0000 7f7d5effd700 1 --2- 172.21.15.50:0/465696335 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f7d5001f9c0 0x7f7d50021ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:09.121 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.107+0000 7f7d5effd700 1 -- 172.21.15.50:0/465696335 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3403+0+0 (secure 0 0 0) 0x7f7d5802ab10 con 0x7f7d6811e6c0 2019-12-19T22:08:09.121 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.107+0000 7f7d6d87a700 1 --2- 172.21.15.50:0/465696335 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f7d5001f9c0 0x7f7d50021ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:09.121 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.107+0000 7f7d6d87a700 1 --2- 172.21.15.50:0/465696335 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f7d5001f9c0 0x7f7d50021ed0 crc :-1 s=READY pgs=23 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:09.122 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.107+0000 7f7d6fade700 1 -- 172.21.15.50:0/465696335 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d68056340 con 0x7f7d6811e6c0 2019-12-19T22:08:09.122 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.110+0000 7f7d6e07b700 1 --2- 172.21.15.50:0/465696335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d6811e6c0 0x7f7d6811eaf0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f7d58008790 tx=0x7f7d5800f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.122 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.110+0000 7f7d5effd700 1 -- 172.21.15.50:0/465696335 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7f7d58005dd0 con 0x7f7d6811e6c0 2019-12-19T22:08:09.251 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.249+0000 7f7d6fade700 1 -- 172.21.15.50:0/465696335 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d68063310 con 0x7f7d6811e6c0 2019-12-19T22:08:09.252 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.250+0000 7f7d6e07b700 1 --2- 172.21.15.50:0/465696335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d6811e6c0 0x7f7d6811eaf0 secure :-1 s=THROTTLE_DONE pgs=101 cs=0 l=1 rx=0x7f7d58008790 tx=0x7f7d5800f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.252 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.250+0000 7f7d5effd700 1 -- 172.21.15.50:0/465696335 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+8801 (secure 0 0 0) 0x7f7d5802a5f0 con 0x7f7d6811e6c0 2019-12-19T22:08:09.252 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:08:09.253 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":17,"fsid":"c1382993-41cc-4b35-a402-c17778701f01","created":"2019-12-19T22:07:52.345475+0000","modified":"2019-12-19T22:08:07.711207+0000","last_up_change":"2019-12-19T22:07:58.357117+0000","last_in_change":"2019-12-19T22:07:58.357117+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-19T22:08:01.570202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2019-12-19T22:08:04.515784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2019-12-19T22:08:05.689151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6137ed8c-8e2c-4e88-8634-dc763bed14c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":27757},{"type":"v1","addr":"172.21.15.50:6817","nonce":27757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":27757},{"type":"v1","addr":"172.21.15.50:6819","nonce":27757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":27757},{"type":"v1","addr":"172.21.15.50:6823","nonce":27757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":27757},{"type":"v1","addr":"172.21.15.50:6821","nonce":27757}]},"public_addr":"172.21.15.50:6817/27757","cluster_addr":"172.21.15.50:6819/27757","heartbeat_back_addr":"172.21.15.50:6823/27757","heartbeat_front_addr":"172.21.15.50:6821/27757","state":["exists","up"]},{"osd":1,"uuid":"57d4e31d-408e-4302-859d-7ea672b93772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":27758},{"type":"v1","addr":"172.21.15.50:6801","nonce":27758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":27758},{"type":"v1","addr":"172.21.15.50:6803","nonce":27758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":27758},{"type":"v1","addr":"172.21.15.50:6810","nonce":27758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6805","nonce":27758},{"type":"v1","addr":"172.21.15.50:6807","nonce":27758}]},"public_addr":"172.21.15.50:6801/27758","cluster_addr":"172.21.15.50:6803/27758","heartbeat_back_addr":"172.21.15.50:6810/27758","heartbeat_front_addr":"172.21.15.50:6807/27758","state":["exists","up"]},{"osd":2,"uuid":"600ea585-aa50-4596-9b14-090eab15f9a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":27759},{"type":"v1","addr":"172.21.15.50:6806","nonce":27759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":27759},{"type":"v1","addr":"172.21.15.50:6811","nonce":27759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":27759},{"type":"v1","addr":"172.21.15.50:6816","nonce":27759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":27759},{"type":"v1","addr":"172.21.15.50:6813","nonce":27759}]},"public_addr":"172.21.15.50:6806/27759","cluster_addr":"172.21.15.50:6811/27759","heartbeat_back_addr":"172.21.15.50:6816/27759","heartbeat_front_addr":"172.21.15.50:6813/27759","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-19T22:07:56.415731+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-19T22:07:56.346062+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-19T22:07:56.090889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-19T22:08:09.254 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.251+0000 7f7d6fade700 1 -- 172.21.15.50:0/465696335 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f7d5001f9c0 msgr2=0x7f7d50021ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:09.254 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.251+0000 7f7d6fade700 1 --2- 172.21.15.50:0/465696335 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f7d5001f9c0 0x7f7d50021ed0 crc :-1 s=READY pgs=23 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:09.254 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.251+0000 7f7d6fade700 1 -- 172.21.15.50:0/465696335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d6811e6c0 msgr2=0x7f7d6811eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:09.254 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.251+0000 7f7d6fade700 1 --2- 172.21.15.50:0/465696335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d6811e6c0 0x7f7d6811eaf0 secure :-1 s=READY pgs=101 cs=0 l=1 rx=0x7f7d58008790 tx=0x7f7d5800f780).stop 2019-12-19T22:08:09.254 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.251+0000 7f7d6fade700 1 -- 172.21.15.50:0/465696335 shutdown_connections 2019-12-19T22:08:09.255 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.251+0000 7f7d6fade700 1 --2- 172.21.15.50:0/465696335 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f7d5001f9c0 0x7f7d50021ed0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:09.255 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.251+0000 7f7d6fade700 1 --2- 172.21.15.50:0/465696335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7d6811e6c0 0x7f7d6811eaf0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:09.255 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.251+0000 7f7d6fade700 1 -- 172.21.15.50:0/465696335 shutdown_connections 2019-12-19T22:08:09.255 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.251+0000 7f7d6fade700 1 -- 172.21.15.50:0/465696335 wait complete. 2019-12-19T22:08:09.256 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.251+0000 7f7d6fade700 1 -- 172.21.15.50:0/465696335 >> 172.21.15.50:0/465696335 conn(0x7f7d68081c40 msgr2=0x7f7d6808bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:09.266 INFO:tasks.ceph.ceph_manager.ceph:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-19T22:08:01.570202+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'13', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-19T22:08:04.515784+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'16', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-19T22:08:05.689151+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-12-19T22:08:09.266 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-12-19T22:08:09.386 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.381+0000 7f64a5b7b700 1 Processor -- start 2019-12-19T22:08:09.386 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.381+0000 7f64a5b7b700 1 -- start start 2019-12-19T22:08:09.398 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.381+0000 7f64a5b7b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f64a007dac0 0x7f64a008eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:09.399 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.381+0000 7f64a5b7b700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64a008fd30 con 0x7f64a0089510 2019-12-19T22:08:09.399 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.381+0000 7f64a5b7b700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64a008f8f0 con 0x7f64a007dac0 2019-12-19T22:08:09.405 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.382+0000 7f649ffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f64a007dac0 0x7f64a008eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:09.405 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.382+0000 7f649ffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f64a007dac0 0x7f64a008eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53572/0 (socket says 172.21.15.50:53572) 2019-12-19T22:08:09.405 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.382+0000 7f649ffff700 1 -- 172.21.15.50:0/3086584036 learned_addr learned my addr 172.21.15.50:0/3086584036 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:09.405 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.382+0000 7f649ffff700 1 -- 172.21.15.50:0/3086584036 >> v1:172.21.15.50:6789/0 conn(0x7f64a0089510 legacy=0x7f64a007e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:09.411 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.382+0000 7f649ffff700 1 -- 172.21.15.50:0/3086584036 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a008de50 con 0x7f64a007dac0 2019-12-19T22:08:09.411 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.382+0000 7f649ffff700 1 --2- 172.21.15.50:0/3086584036 >> v2:172.21.15.50:3300/0 conn(0x7f64a007dac0 0x7f64a008eb70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6490008790 tx=0x7f649000fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.411 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.382+0000 7f649ffff700 1 --2- 172.21.15.50:0/3086584036 >> v2:172.21.15.50:3300/0 conn(0x7f64a007dac0 0x7f64a008eb70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6490008790 tx=0x7f649000fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.411 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.382+0000 7f649ffff700 1 --2- 172.21.15.50:0/3086584036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64a007dac0 0x7f64a008eb70 secure :-1 s=READY pgs=103 cs=0 l=1 rx=0x7f6490008790 tx=0x7f649000fcb0).ready entity=mon.0 client_cookie=8492d2a3f43d22f0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:09.414 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.382+0000 7f649ffff700 1 --2- 172.21.15.50:0/3086584036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64a007dac0 0x7f64a008eb70 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f6490008790 tx=0x7f649000fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.414 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.382+0000 7f649f7fe700 1 -- 172.21.15.50:0/3086584036 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f64900112f0 con 0x7f64a007dac0 2019-12-19T22:08:09.414 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.382+0000 7f649ffff700 1 --2- 172.21.15.50:0/3086584036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64a007dac0 0x7f64a008eb70 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f6490008790 tx=0x7f649000fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.414 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.382+0000 7f649ffff700 1 --2- 172.21.15.50:0/3086584036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64a007dac0 0x7f64a008eb70 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f6490008790 tx=0x7f649000fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.414 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.382+0000 7f649f7fe700 1 -- 172.21.15.50:0/3086584036 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64900114f0 con 0x7f64a007dac0 2019-12-19T22:08:09.415 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.382+0000 7f649f7fe700 1 -- 172.21.15.50:0/3086584036 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f6490011810 con 0x7f64a007dac0 2019-12-19T22:08:09.415 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.382+0000 7f64a5b7b700 1 -- 172.21.15.50:0/3086584036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64a007dac0 msgr2=0x7f64a008eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:09.415 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.382+0000 7f64a5b7b700 1 --2- 172.21.15.50:0/3086584036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64a007dac0 0x7f64a008eb70 secure :-1 s=READY pgs=103 cs=0 l=1 rx=0x7f6490008790 tx=0x7f649000fcb0).stop 2019-12-19T22:08:09.415 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.383+0000 7f64a5b7b700 1 -- 172.21.15.50:0/3086584036 shutdown_connections 2019-12-19T22:08:09.415 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.383+0000 7f64a5b7b700 1 --2- 172.21.15.50:0/3086584036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64a007dac0 0x7f64a008eb70 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:09.415 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.383+0000 7f64a5b7b700 1 -- 172.21.15.50:0/3086584036 shutdown_connections 2019-12-19T22:08:09.415 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.383+0000 7f64a5b7b700 1 -- 172.21.15.50:0/3086584036 wait complete. 2019-12-19T22:08:09.416 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.383+0000 7f64a5b7b700 1 -- 172.21.15.50:0/3086584036 >> 172.21.15.50:0/3086584036 conn(0x7f64a0092f20 msgr2=0x7f64a008b240 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:09.416 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.384+0000 7f64a5b7b700 1 Processor -- start 2019-12-19T22:08:09.416 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.384+0000 7f64a5b7b700 1 -- start start 2019-12-19T22:08:09.425 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.384+0000 7f64a5b7b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f64a007ac80 0x7f64a0126ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:09.425 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.384+0000 7f64a5b7b700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64a007b0b0 con 0x7f64a0088c00 2019-12-19T22:08:09.425 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.384+0000 7f64a5b7b700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64a0091850 con 0x7f64a007ac80 2019-12-19T22:08:09.426 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.384+0000 7f649ffff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f64a0088c00 0x7f64a007a480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39704/0 (socket says 172.21.15.50:39704) 2019-12-19T22:08:09.426 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.384+0000 7f649ffff700 1 -- 172.21.15.50:0/1009734152 learned_addr learned my addr 172.21.15.50:0/1009734152 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:09.426 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.384+0000 7f6497fff700 1 --2- 172.21.15.50:0/1009734152 >> v2:172.21.15.50:3300/0 conn(0x7f64a007ac80 0x7f64a0126ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:09.426 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.384+0000 7f6497fff700 1 -- 172.21.15.50:0/1009734152 >> v1:172.21.15.50:6789/0 conn(0x7f64a0088c00 legacy=0x7f64a007a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:09.426 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.384+0000 7f6497fff700 1 -- 172.21.15.50:0/1009734152 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a0088630 con 0x7f64a007ac80 2019-12-19T22:08:09.426 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.384+0000 7f649d7fa700 1 -- 172.21.15.50:0/1009734152 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1923759446 0 0) 0x7f64a007b0b0 con 0x7f64a0088c00 2019-12-19T22:08:09.426 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.385+0000 7f6497fff700 1 --2- 172.21.15.50:0/1009734152 >> v2:172.21.15.50:3300/0 conn(0x7f64a007ac80 0x7f64a0126ab0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6488001430 tx=0x7f648800c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.427 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.385+0000 7f6497fff700 1 --2- 172.21.15.50:0/1009734152 >> v2:172.21.15.50:3300/0 conn(0x7f64a007ac80 0x7f64a0126ab0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6488001430 tx=0x7f648800c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.427 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.385+0000 7f6497fff700 1 --2- 172.21.15.50:0/1009734152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64a007ac80 0x7f64a0126ab0 secure :-1 s=READY pgs=105 cs=0 l=1 rx=0x7f6488001430 tx=0x7f648800c320).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:09.427 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.385+0000 7f6497fff700 1 --2- 172.21.15.50:0/1009734152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64a007ac80 0x7f64a0126ab0 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f6488001430 tx=0x7f648800c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.427 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.385+0000 7f649d7fa700 1 -- 172.21.15.50:0/1009734152 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f648800c9f0 con 0x7f64a007ac80 2019-12-19T22:08:09.427 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.385+0000 7f6497fff700 1 --2- 172.21.15.50:0/1009734152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64a007ac80 0x7f64a0126ab0 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f6488001430 tx=0x7f648800c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.427 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.385+0000 7f6497fff700 1 --2- 172.21.15.50:0/1009734152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64a007ac80 0x7f64a0126ab0 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f6488001430 tx=0x7f648800c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.428 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.385+0000 7f649d7fa700 1 -- 172.21.15.50:0/1009734152 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648800cbf0 con 0x7f64a007ac80 2019-12-19T22:08:09.428 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.385+0000 7f64a5b7b700 1 -- 172.21.15.50:0/1009734152 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64a0089030 con 0x7f64a007ac80 2019-12-19T22:08:09.428 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.385+0000 7f649d7fa700 1 -- 172.21.15.50:0/1009734152 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f6488010e40 con 0x7f64a007ac80 2019-12-19T22:08:09.428 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.385+0000 7f64a5b7b700 1 -- 172.21.15.50:0/1009734152 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64a0127000 con 0x7f64a007ac80 2019-12-19T22:08:09.428 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.385+0000 7f6497fff700 1 --2- 172.21.15.50:0/1009734152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64a007ac80 0x7f64a0126ab0 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f6488001430 tx=0x7f648800c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.430 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.385+0000 7f649d7fa700 1 -- 172.21.15.50:0/1009734152 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7f6488007430 con 0x7f64a007ac80 2019-12-19T22:08:09.430 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.385+0000 7f6497fff700 1 --2- 172.21.15.50:0/1009734152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64a007ac80 0x7f64a0126ab0 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f6488001430 tx=0x7f648800c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.430 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.385+0000 7f649d7fa700 1 --2- 172.21.15.50:0/1009734152 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f648401f950 0x7f6484021e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:09.430 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.385+0000 7f649d7fa700 1 -- 172.21.15.50:0/1009734152 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3403+0+0 (secure 0 0 0) 0x7f648802a500 con 0x7f64a007ac80 2019-12-19T22:08:09.430 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.385+0000 7f649ffff700 1 --2- 172.21.15.50:0/1009734152 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f648401f950 0x7f6484021e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:09.430 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.386+0000 7f649ffff700 1 --2- 172.21.15.50:0/1009734152 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f648401f950 0x7f6484021e60 crc :-1 s=READY pgs=24 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:09.431 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.386+0000 7f64a5b7b700 1 -- 172.21.15.50:0/1009734152 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64a0056340 con 0x7f64a007ac80 2019-12-19T22:08:09.431 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.389+0000 7f6497fff700 1 --2- 172.21.15.50:0/1009734152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64a007ac80 0x7f64a0126ab0 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f6488001430 tx=0x7f648800c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.431 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.389+0000 7f649d7fa700 1 -- 172.21.15.50:0/1009734152 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7f6488007740 con 0x7f64a007ac80 2019-12-19T22:08:09.529 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.526+0000 7f64a5b7b700 1 -- 172.21.15.50:0/1009734152 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f64a0095360 con 0x7f64a007ac80 2019-12-19T22:08:09.530 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.527+0000 7f6497fff700 1 --2- 172.21.15.50:0/1009734152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64a007ac80 0x7f64a0126ab0 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7f6488001430 tx=0x7f648800c320).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.530 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.527+0000 7f649d7fa700 1 -- 172.21.15.50:0/1009734152 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f648800b1f0 con 0x7f64a007ac80 2019-12-19T22:08:09.530 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2019-12-19T22:08:09.531 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.528+0000 7f64a5b7b700 1 -- 172.21.15.50:0/1009734152 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f648401f950 msgr2=0x7f6484021e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:09.531 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.528+0000 7f64a5b7b700 1 --2- 172.21.15.50:0/1009734152 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f648401f950 0x7f6484021e60 crc :-1 s=READY pgs=24 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:09.531 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.528+0000 7f64a5b7b700 1 -- 172.21.15.50:0/1009734152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64a007ac80 msgr2=0x7f64a0126ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:09.532 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.528+0000 7f64a5b7b700 1 --2- 172.21.15.50:0/1009734152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64a007ac80 0x7f64a0126ab0 secure :-1 s=READY pgs=105 cs=0 l=1 rx=0x7f6488001430 tx=0x7f648800c320).stop 2019-12-19T22:08:09.532 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.528+0000 7f64a5b7b700 1 -- 172.21.15.50:0/1009734152 shutdown_connections 2019-12-19T22:08:09.534 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.528+0000 7f64a5b7b700 1 --2- 172.21.15.50:0/1009734152 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f648401f950 0x7f6484021e60 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:09.534 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.528+0000 7f64a5b7b700 1 --2- 172.21.15.50:0/1009734152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64a007ac80 0x7f64a0126ab0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:09.534 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.528+0000 7f64a5b7b700 1 -- 172.21.15.50:0/1009734152 shutdown_connections 2019-12-19T22:08:09.535 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.528+0000 7f64a5b7b700 1 -- 172.21.15.50:0/1009734152 wait complete. 2019-12-19T22:08:09.535 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.528+0000 7f64a5b7b700 1 -- 172.21.15.50:0/1009734152 >> 172.21.15.50:0/1009734152 conn(0x7f64a0090040 msgr2=0x7f64a0092f20 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:09.540 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-12-19T22:08:09.658 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.653+0000 7fdfa3067700 1 Processor -- start 2019-12-19T22:08:09.659 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.654+0000 7fdfa3067700 1 -- start start 2019-12-19T22:08:09.659 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.654+0000 7fdfa3067700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdf9c07dac0 0x7fdf9c08eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:09.659 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.654+0000 7fdfa3067700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf9c08fd30 con 0x7fdf9c089510 2019-12-19T22:08:09.659 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.654+0000 7fdfa3067700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf9c08f8f0 con 0x7fdf9c07dac0 2019-12-19T22:08:09.659 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.654+0000 7fdfa0e03700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fdf9c089510 0x7fdf9c07e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39710/0 (socket says 172.21.15.50:39710) 2019-12-19T22:08:09.659 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.654+0000 7fdfa0e03700 1 -- 172.21.15.50:0/22905965 learned_addr learned my addr 172.21.15.50:0/22905965 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:09.659 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.654+0000 7fdfa1604700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdf9c07dac0 0x7fdf9c08eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:09.660 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.655+0000 7fdfa1604700 1 -- 172.21.15.50:0/22905965 >> v1:172.21.15.50:6789/0 conn(0x7fdf9c089510 legacy=0x7fdf9c07e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:09.660 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.655+0000 7fdfa1604700 1 -- 172.21.15.50:0/22905965 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf9c08de50 con 0x7fdf9c07dac0 2019-12-19T22:08:09.660 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.655+0000 7fdfa1604700 1 --2- 172.21.15.50:0/22905965 >> v2:172.21.15.50:3300/0 conn(0x7fdf9c07dac0 0x7fdf9c08eb70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdf98008790 tx=0x7fdf9800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.660 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.655+0000 7fdfa1604700 1 --2- 172.21.15.50:0/22905965 >> v2:172.21.15.50:3300/0 conn(0x7fdf9c07dac0 0x7fdf9c08eb70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdf98008790 tx=0x7fdf9800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.660 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.655+0000 7fdfa1604700 1 --2- 172.21.15.50:0/22905965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf9c07dac0 0x7fdf9c08eb70 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7fdf98008790 tx=0x7fdf9800fbf0).ready entity=mon.0 client_cookie=5e5435695badd45a server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:09.660 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.655+0000 7fdfa1604700 1 --2- 172.21.15.50:0/22905965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf9c07dac0 0x7fdf9c08eb70 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7fdf98008790 tx=0x7fdf9800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.661 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.655+0000 7fdf93fff700 1 -- 172.21.15.50:0/22905965 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fdf98011230 con 0x7fdf9c07dac0 2019-12-19T22:08:09.661 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.655+0000 7fdfa1604700 1 --2- 172.21.15.50:0/22905965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf9c07dac0 0x7fdf9c08eb70 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7fdf98008790 tx=0x7fdf9800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.661 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.655+0000 7fdf93fff700 1 -- 172.21.15.50:0/22905965 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf98011430 con 0x7fdf9c07dac0 2019-12-19T22:08:09.661 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.655+0000 7fdfa1604700 1 --2- 172.21.15.50:0/22905965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf9c07dac0 0x7fdf9c08eb70 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7fdf98008790 tx=0x7fdf9800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.661 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.655+0000 7fdf93fff700 1 -- 172.21.15.50:0/22905965 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fdf98011790 con 0x7fdf9c07dac0 2019-12-19T22:08:09.662 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.655+0000 7fdfa3067700 1 -- 172.21.15.50:0/22905965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf9c07dac0 msgr2=0x7fdf9c08eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:09.662 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.655+0000 7fdfa3067700 1 --2- 172.21.15.50:0/22905965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf9c07dac0 0x7fdf9c08eb70 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7fdf98008790 tx=0x7fdf9800fbf0).stop 2019-12-19T22:08:09.662 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.655+0000 7fdfa3067700 1 -- 172.21.15.50:0/22905965 shutdown_connections 2019-12-19T22:08:09.662 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.655+0000 7fdfa3067700 1 --2- 172.21.15.50:0/22905965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf9c07dac0 0x7fdf9c08eb70 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:09.663 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.655+0000 7fdfa3067700 1 -- 172.21.15.50:0/22905965 shutdown_connections 2019-12-19T22:08:09.663 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.655+0000 7fdfa3067700 1 -- 172.21.15.50:0/22905965 wait complete. 2019-12-19T22:08:09.663 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.655+0000 7fdfa3067700 1 -- 172.21.15.50:0/22905965 >> 172.21.15.50:0/22905965 conn(0x7fdf9c092f20 msgr2=0x7fdf9c08b240 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:09.668 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.656+0000 7fdfa3067700 1 Processor -- start 2019-12-19T22:08:09.668 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.656+0000 7fdfa3067700 1 -- start start 2019-12-19T22:08:09.668 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.657+0000 7fdfa3067700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdf9c124ac0 0x7fdf9c126f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:09.668 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.657+0000 7fdfa3067700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf9c07d940 con 0x7fdf9c082610 2019-12-19T22:08:09.669 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.657+0000 7fdfa3067700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf9c07bdb0 con 0x7fdf9c124ac0 2019-12-19T22:08:09.669 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.657+0000 7fdfa1604700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fdf9c082610 0x7fdf9c121db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39714/0 (socket says 172.21.15.50:39714) 2019-12-19T22:08:09.670 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.657+0000 7fdfa1604700 1 -- 172.21.15.50:0/344762625 learned_addr learned my addr 172.21.15.50:0/344762625 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:09.670 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.657+0000 7fdfa0e03700 1 --2- 172.21.15.50:0/344762625 >> v2:172.21.15.50:3300/0 conn(0x7fdf9c124ac0 0x7fdf9c126f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:09.670 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.657+0000 7fdf91ffb700 1 -- 172.21.15.50:0/344762625 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2629947824 0 0) 0x7fdf9c07d940 con 0x7fdf9c082610 2019-12-19T22:08:09.670 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.657+0000 7fdf91ffb700 1 -- 172.21.15.50:0/344762625 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf7c0030b0 con 0x7fdf9c082610 2019-12-19T22:08:09.671 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.657+0000 7fdfa0e03700 1 -- 172.21.15.50:0/344762625 >> v1:172.21.15.50:6789/0 conn(0x7fdf9c082610 legacy=0x7fdf9c121db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:09.671 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.657+0000 7fdfa0e03700 1 -- 172.21.15.50:0/344762625 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf9c1225b0 con 0x7fdf9c124ac0 2019-12-19T22:08:09.671 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.657+0000 7fdfa0e03700 1 --2- 172.21.15.50:0/344762625 >> v2:172.21.15.50:3300/0 conn(0x7fdf9c124ac0 0x7fdf9c126f00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdf9c07c950 tx=0x7fdf8c010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.671 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.658+0000 7fdfa0e03700 1 --2- 172.21.15.50:0/344762625 >> v2:172.21.15.50:3300/0 conn(0x7fdf9c124ac0 0x7fdf9c126f00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdf9c07c950 tx=0x7fdf8c010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.671 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.658+0000 7fdfa0e03700 1 --2- 172.21.15.50:0/344762625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf9c124ac0 0x7fdf9c126f00 secure :-1 s=READY pgs=109 cs=0 l=1 rx=0x7fdf9c07c950 tx=0x7fdf8c010810).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:09.672 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.658+0000 7fdfa0e03700 1 --2- 172.21.15.50:0/344762625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf9c124ac0 0x7fdf9c126f00 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7fdf9c07c950 tx=0x7fdf8c010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.672 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.658+0000 7fdf91ffb700 1 -- 172.21.15.50:0/344762625 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fdf8c011470 con 0x7fdf9c124ac0 2019-12-19T22:08:09.672 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.658+0000 7fdfa0e03700 1 --2- 172.21.15.50:0/344762625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf9c124ac0 0x7fdf9c126f00 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7fdf9c07c950 tx=0x7fdf8c010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.672 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.658+0000 7fdf91ffb700 1 -- 172.21.15.50:0/344762625 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8c011670 con 0x7fdf9c124ac0 2019-12-19T22:08:09.673 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.658+0000 7fdfa0e03700 1 --2- 172.21.15.50:0/344762625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf9c124ac0 0x7fdf9c126f00 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7fdf9c07c950 tx=0x7fdf8c010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.673 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.658+0000 7fdfa3067700 1 -- 172.21.15.50:0/344762625 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf9c07c570 con 0x7fdf9c124ac0 2019-12-19T22:08:09.674 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.658+0000 7fdf91ffb700 1 -- 172.21.15.50:0/344762625 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fdf8c011990 con 0x7fdf9c124ac0 2019-12-19T22:08:09.674 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.658+0000 7fdfa3067700 1 -- 172.21.15.50:0/344762625 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf9c07ce20 con 0x7fdf9c124ac0 2019-12-19T22:08:09.674 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.658+0000 7fdfa0e03700 1 --2- 172.21.15.50:0/344762625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf9c124ac0 0x7fdf9c126f00 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7fdf9c07c950 tx=0x7fdf8c010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.675 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.658+0000 7fdf91ffb700 1 -- 172.21.15.50:0/344762625 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7fdf8c00b330 con 0x7fdf9c124ac0 2019-12-19T22:08:09.675 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.658+0000 7fdfa0e03700 1 --2- 172.21.15.50:0/344762625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf9c124ac0 0x7fdf9c126f00 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7fdf9c07c950 tx=0x7fdf8c010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.675 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.658+0000 7fdf91ffb700 1 --2- 172.21.15.50:0/344762625 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fdf7c01ffc0 0x7fdf7c0224d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:09.676 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.658+0000 7fdf91ffb700 1 -- 172.21.15.50:0/344762625 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3403+0+0 (secure 0 0 0) 0x7fdf8c02a410 con 0x7fdf9c124ac0 2019-12-19T22:08:09.676 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.658+0000 7fdfa1604700 1 --2- 172.21.15.50:0/344762625 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fdf7c01ffc0 0x7fdf7c0224d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:09.676 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.659+0000 7fdfa1604700 1 --2- 172.21.15.50:0/344762625 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fdf7c01ffc0 0x7fdf7c0224d0 crc :-1 s=READY pgs=25 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:09.676 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.659+0000 7fdfa3067700 1 -- 172.21.15.50:0/344762625 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf9c07d540 con 0x7fdf9c124ac0 2019-12-19T22:08:09.677 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.662+0000 7fdfa0e03700 1 --2- 172.21.15.50:0/344762625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf9c124ac0 0x7fdf9c126f00 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7fdf9c07c950 tx=0x7fdf8c010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.678 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.662+0000 7fdf91ffb700 1 -- 172.21.15.50:0/344762625 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7fdf9c1225b0 con 0x7fdf9c124ac0 2019-12-19T22:08:09.810 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.807+0000 7fdfa3067700 1 -- 172.21.15.50:0/344762625 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdf9c056340 con 0x7fdf9c124ac0 2019-12-19T22:08:09.810 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.807+0000 7fdfa0e03700 1 --2- 172.21.15.50:0/344762625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf9c124ac0 0x7fdf9c126f00 secure :-1 s=THROTTLE_DONE pgs=109 cs=0 l=1 rx=0x7fdf9c07c950 tx=0x7fdf8c010810).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.810 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.807+0000 7fdf91ffb700 1 -- 172.21.15.50:0/344762625 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v17) v1 ==== 104+0+10 (secure 0 0 0) 0x7fdf8c011be0 con 0x7fdf9c124ac0 2019-12-19T22:08:09.810 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2019-12-19T22:08:09.811 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.809+0000 7fdfa3067700 1 -- 172.21.15.50:0/344762625 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fdf7c01ffc0 msgr2=0x7fdf7c0224d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:09.812 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.809+0000 7fdfa3067700 1 --2- 172.21.15.50:0/344762625 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fdf7c01ffc0 0x7fdf7c0224d0 crc :-1 s=READY pgs=25 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:09.812 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.809+0000 7fdfa3067700 1 -- 172.21.15.50:0/344762625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf9c124ac0 msgr2=0x7fdf9c126f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:09.812 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.809+0000 7fdfa3067700 1 --2- 172.21.15.50:0/344762625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf9c124ac0 0x7fdf9c126f00 secure :-1 s=READY pgs=109 cs=0 l=1 rx=0x7fdf9c07c950 tx=0x7fdf8c010810).stop 2019-12-19T22:08:09.812 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.809+0000 7fdfa3067700 1 -- 172.21.15.50:0/344762625 shutdown_connections 2019-12-19T22:08:09.812 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.809+0000 7fdfa3067700 1 --2- 172.21.15.50:0/344762625 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fdf7c01ffc0 0x7fdf7c0224d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:09.813 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.809+0000 7fdfa3067700 1 --2- 172.21.15.50:0/344762625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf9c124ac0 0x7fdf9c126f00 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:09.813 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.809+0000 7fdfa3067700 1 -- 172.21.15.50:0/344762625 shutdown_connections 2019-12-19T22:08:09.813 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.809+0000 7fdfa3067700 1 -- 172.21.15.50:0/344762625 wait complete. 2019-12-19T22:08:09.813 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.809+0000 7fdfa3067700 1 -- 172.21.15.50:0/344762625 >> 172.21.15.50:0/344762625 conn(0x7fdf9c08ffa0 msgr2=0x7fdf9c089720 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:09.821 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-12-19T22:08:09.940 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.935+0000 7f074feb6700 1 Processor -- start 2019-12-19T22:08:09.940 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.935+0000 7f074feb6700 1 -- start start 2019-12-19T22:08:09.940 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.935+0000 7f074feb6700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f074807dac0 0x7f074808eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:09.940 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.935+0000 7f074feb6700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f074808fd30 con 0x7f0748089510 2019-12-19T22:08:09.940 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.935+0000 7f074feb6700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f074808f8f0 con 0x7f074807dac0 2019-12-19T22:08:09.941 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.935+0000 7f074e453700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f074807dac0 0x7f074808eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:09.941 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.935+0000 7f074e453700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f074807dac0 0x7f074808eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53600/0 (socket says 172.21.15.50:53600) 2019-12-19T22:08:09.941 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.935+0000 7f074dc52700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0748089510 0x7f074807e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39728/0 (socket says 172.21.15.50:39728) 2019-12-19T22:08:09.941 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.935+0000 7f074e453700 1 -- 172.21.15.50:0/1087816411 learned_addr learned my addr 172.21.15.50:0/1087816411 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:09.941 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.936+0000 7f074e453700 1 -- 172.21.15.50:0/1087816411 >> v1:172.21.15.50:6789/0 conn(0x7f0748089510 legacy=0x7f074807e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:09.941 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.936+0000 7f074e453700 1 -- 172.21.15.50:0/1087816411 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f074808de50 con 0x7f074807dac0 2019-12-19T22:08:09.941 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.936+0000 7f074e453700 1 --2- 172.21.15.50:0/1087816411 >> v2:172.21.15.50:3300/0 conn(0x7f074807dac0 0x7f074808eb70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0738008790 tx=0x7f073800fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.942 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.936+0000 7f074e453700 1 --2- 172.21.15.50:0/1087816411 >> v2:172.21.15.50:3300/0 conn(0x7f074807dac0 0x7f074808eb70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0738008790 tx=0x7f073800fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.942 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.936+0000 7f074e453700 1 --2- 172.21.15.50:0/1087816411 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f074807dac0 0x7f074808eb70 secure :-1 s=READY pgs=111 cs=0 l=1 rx=0x7f0738008790 tx=0x7f073800fcb0).ready entity=mon.0 client_cookie=1dc832048d7764a6 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:09.942 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.936+0000 7f074e453700 1 --2- 172.21.15.50:0/1087816411 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f074807dac0 0x7f074808eb70 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7f0738008790 tx=0x7f073800fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.942 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.936+0000 7f074d451700 1 -- 172.21.15.50:0/1087816411 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f07380112f0 con 0x7f074807dac0 2019-12-19T22:08:09.942 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.936+0000 7f074e453700 1 --2- 172.21.15.50:0/1087816411 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f074807dac0 0x7f074808eb70 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7f0738008790 tx=0x7f073800fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.942 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.936+0000 7f074e453700 1 --2- 172.21.15.50:0/1087816411 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f074807dac0 0x7f074808eb70 secure :-1 s=THROTTLE_DONE pgs=111 cs=0 l=1 rx=0x7f0738008790 tx=0x7f073800fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.942 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.936+0000 7f074d451700 1 -- 172.21.15.50:0/1087816411 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07380114f0 con 0x7f074807dac0 2019-12-19T22:08:09.943 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.936+0000 7f074d451700 1 -- 172.21.15.50:0/1087816411 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f0738011810 con 0x7f074807dac0 2019-12-19T22:08:09.943 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.936+0000 7f074feb6700 1 -- 172.21.15.50:0/1087816411 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f074807dac0 msgr2=0x7f074808eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:09.943 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.936+0000 7f074feb6700 1 --2- 172.21.15.50:0/1087816411 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f074807dac0 0x7f074808eb70 secure :-1 s=READY pgs=111 cs=0 l=1 rx=0x7f0738008790 tx=0x7f073800fcb0).stop 2019-12-19T22:08:09.943 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.937+0000 7f074feb6700 1 -- 172.21.15.50:0/1087816411 shutdown_connections 2019-12-19T22:08:09.943 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.937+0000 7f074feb6700 1 --2- 172.21.15.50:0/1087816411 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f074807dac0 0x7f074808eb70 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:09.943 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.937+0000 7f074feb6700 1 -- 172.21.15.50:0/1087816411 shutdown_connections 2019-12-19T22:08:09.943 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.937+0000 7f074feb6700 1 -- 172.21.15.50:0/1087816411 wait complete. 2019-12-19T22:08:09.944 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.937+0000 7f074feb6700 1 -- 172.21.15.50:0/1087816411 >> 172.21.15.50:0/1087816411 conn(0x7f0748092f20 msgr2=0x7f074808b240 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:09.944 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.937+0000 7f074feb6700 1 Processor -- start 2019-12-19T22:08:09.944 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.938+0000 7f074feb6700 1 -- start start 2019-12-19T22:08:09.947 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.938+0000 7f074feb6700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0748122910 0x7f0748124d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:09.947 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.938+0000 7f074feb6700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0748064b10 con 0x7f074807a4d0 2019-12-19T22:08:09.947 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.938+0000 7f074feb6700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07480917a0 con 0x7f0748122910 2019-12-19T22:08:09.947 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.938+0000 7f074e453700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f074807a4d0 0x7f074807a900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39732/0 (socket says 172.21.15.50:39732) 2019-12-19T22:08:09.947 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.938+0000 7f074e453700 1 -- 172.21.15.50:0/3878142611 learned_addr learned my addr 172.21.15.50:0/3878142611 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:09.947 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.938+0000 7f074dc52700 1 --2- 172.21.15.50:0/3878142611 >> v2:172.21.15.50:3300/0 conn(0x7f0748122910 0x7f0748124d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:09.948 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.938+0000 7f074dc52700 1 -- 172.21.15.50:0/3878142611 >> v1:172.21.15.50:6789/0 conn(0x7f074807a4d0 legacy=0x7f074807a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:09.948 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.938+0000 7f073effd700 1 -- 172.21.15.50:0/3878142611 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4156012984 0 0) 0x7f0748064b10 con 0x7f074807a4d0 2019-12-19T22:08:09.948 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.938+0000 7f074dc52700 1 -- 172.21.15.50:0/3878142611 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0748066240 con 0x7f0748122910 2019-12-19T22:08:09.948 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.938+0000 7f074dc52700 1 --2- 172.21.15.50:0/3878142611 >> v2:172.21.15.50:3300/0 conn(0x7f0748122910 0x7f0748124d50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f07480634c0 tx=0x7f07440107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.948 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.938+0000 7f074dc52700 1 --2- 172.21.15.50:0/3878142611 >> v2:172.21.15.50:3300/0 conn(0x7f0748122910 0x7f0748124d50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f07480634c0 tx=0x7f07440107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.948 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.938+0000 7f074dc52700 1 --2- 172.21.15.50:0/3878142611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0748122910 0x7f0748124d50 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7f07480634c0 tx=0x7f07440107b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:09.948 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.939+0000 7f074dc52700 1 --2- 172.21.15.50:0/3878142611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0748122910 0x7f0748124d50 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f07480634c0 tx=0x7f07440107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.949 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.939+0000 7f073effd700 1 -- 172.21.15.50:0/3878142611 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f07440066d0 con 0x7f0748122910 2019-12-19T22:08:09.949 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.939+0000 7f074dc52700 1 --2- 172.21.15.50:0/3878142611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0748122910 0x7f0748124d50 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f07480634c0 tx=0x7f07440107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.949 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.939+0000 7f074dc52700 1 --2- 172.21.15.50:0/3878142611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0748122910 0x7f0748124d50 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f07480634c0 tx=0x7f07440107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.950 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.939+0000 7f073effd700 1 -- 172.21.15.50:0/3878142611 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07440068d0 con 0x7f0748122910 2019-12-19T22:08:09.950 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.939+0000 7f074feb6700 1 -- 172.21.15.50:0/3878142611 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0748064760 con 0x7f0748122910 2019-12-19T22:08:09.950 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.939+0000 7f073effd700 1 -- 172.21.15.50:0/3878142611 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f0744006cb0 con 0x7f0748122910 2019-12-19T22:08:09.950 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.939+0000 7f074feb6700 1 -- 172.21.15.50:0/3878142611 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07481252a0 con 0x7f0748122910 2019-12-19T22:08:09.950 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.939+0000 7f074dc52700 1 --2- 172.21.15.50:0/3878142611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0748122910 0x7f0748124d50 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f07480634c0 tx=0x7f07440107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.950 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.939+0000 7f074dc52700 1 --2- 172.21.15.50:0/3878142611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0748122910 0x7f0748124d50 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f07480634c0 tx=0x7f07440107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.950 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.939+0000 7f073effd700 1 -- 172.21.15.50:0/3878142611 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7f07440111b0 con 0x7f0748122910 2019-12-19T22:08:09.951 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.939+0000 7f073effd700 1 --2- 172.21.15.50:0/3878142611 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f073001f970 0x7f0730021e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:09.951 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.939+0000 7f073effd700 1 -- 172.21.15.50:0/3878142611 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3403+0+0 (secure 0 0 0) 0x7f074402a2d0 con 0x7f0748122910 2019-12-19T22:08:09.951 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.939+0000 7f074e453700 1 --2- 172.21.15.50:0/3878142611 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f073001f970 0x7f0730021e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:09.951 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.940+0000 7f074e453700 1 --2- 172.21.15.50:0/3878142611 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f073001f970 0x7f0730021e80 crc :-1 s=READY pgs=27 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:09.951 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.940+0000 7f074feb6700 1 -- 172.21.15.50:0/3878142611 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0748056340 con 0x7f0748122910 2019-12-19T22:08:09.951 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.943+0000 7f074dc52700 1 --2- 172.21.15.50:0/3878142611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0748122910 0x7f0748124d50 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f07480634c0 tx=0x7f07440107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:09.951 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:09.943+0000 7f073effd700 1 -- 172.21.15.50:0/3878142611 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7f0744011840 con 0x7f0748122910 2019-12-19T22:08:10.083 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.081+0000 7f074feb6700 1 -- 172.21.15.50:0/3878142611 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0748063120 con 0x7f0748122910 2019-12-19T22:08:10.083 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.081+0000 7f074dc52700 1 --2- 172.21.15.50:0/3878142611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0748122910 0x7f0748124d50 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7f07480634c0 tx=0x7f07440107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:10.084 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.081+0000 7f073effd700 1 -- 172.21.15.50:0/3878142611 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v17) v1 ==== 100+0+10 (secure 0 0 0) 0x7f07440053c0 con 0x7f0748122910 2019-12-19T22:08:10.084 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2019-12-19T22:08:10.085 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.082+0000 7f074feb6700 1 -- 172.21.15.50:0/3878142611 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f073001f970 msgr2=0x7f0730021e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:10.085 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.082+0000 7f074feb6700 1 --2- 172.21.15.50:0/3878142611 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f073001f970 0x7f0730021e80 crc :-1 s=READY pgs=27 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:10.085 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.082+0000 7f074feb6700 1 -- 172.21.15.50:0/3878142611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0748122910 msgr2=0x7f0748124d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:10.085 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.082+0000 7f074feb6700 1 --2- 172.21.15.50:0/3878142611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0748122910 0x7f0748124d50 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7f07480634c0 tx=0x7f07440107b0).stop 2019-12-19T22:08:10.085 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.082+0000 7f074feb6700 1 -- 172.21.15.50:0/3878142611 shutdown_connections 2019-12-19T22:08:10.086 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.082+0000 7f074feb6700 1 --2- 172.21.15.50:0/3878142611 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f073001f970 0x7f0730021e80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:10.086 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.082+0000 7f074feb6700 1 --2- 172.21.15.50:0/3878142611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0748122910 0x7f0748124d50 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:10.086 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.082+0000 7f074feb6700 1 -- 172.21.15.50:0/3878142611 shutdown_connections 2019-12-19T22:08:10.086 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.082+0000 7f074feb6700 1 -- 172.21.15.50:0/3878142611 wait complete. 2019-12-19T22:08:10.086 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.082+0000 7f074feb6700 1 -- 172.21.15.50:0/3878142611 >> 172.21.15.50:0/3878142611 conn(0x7f074808ffa0 msgr2=0x7f0748089720 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:10.095 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2019-12-19T22:08:10.095 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2019-12-19T22:08:10.095 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2019-12-19T22:08:10.211 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.206+0000 7f1af2f74700 1 Processor -- start 2019-12-19T22:08:10.212 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.206+0000 7f1af2f74700 1 -- start start 2019-12-19T22:08:10.212 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.207+0000 7f1af2f74700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1aec0898b0 0x7f1aec081170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:10.212 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.207+0000 7f1af2f74700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aec089ce0 con 0x7f1aec089480 2019-12-19T22:08:10.212 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.207+0000 7f1af2f74700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aec08ae60 con 0x7f1aec0898b0 2019-12-19T22:08:10.212 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.207+0000 7f1af0d10700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1aec0898b0 0x7f1aec081170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:10.212 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.207+0000 7f1af0d10700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1aec0898b0 0x7f1aec081170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53610/0 (socket says 172.21.15.50:53610) 2019-12-19T22:08:10.213 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.207+0000 7f1af0d10700 1 -- 172.21.15.50:0/2535515955 learned_addr learned my addr 172.21.15.50:0/2535515955 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:10.213 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.207+0000 7f1af0d10700 1 -- 172.21.15.50:0/2535515955 >> v1:172.21.15.50:6789/0 conn(0x7f1aec089480 legacy=0x7f1aec08f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:10.213 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.207+0000 7f1af0d10700 1 -- 172.21.15.50:0/2535515955 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aec08edb0 con 0x7f1aec0898b0 2019-12-19T22:08:10.213 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.207+0000 7f1af0d10700 1 --2- 172.21.15.50:0/2535515955 >> v2:172.21.15.50:3300/0 conn(0x7f1aec0898b0 0x7f1aec081170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1adc008790 tx=0x7f1adc00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:10.213 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.207+0000 7f1af0d10700 1 --2- 172.21.15.50:0/2535515955 >> v2:172.21.15.50:3300/0 conn(0x7f1aec0898b0 0x7f1aec081170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1adc008790 tx=0x7f1adc00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:10.213 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.207+0000 7f1af0d10700 1 --2- 172.21.15.50:0/2535515955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aec0898b0 0x7f1aec081170 secure :-1 s=READY pgs=115 cs=0 l=1 rx=0x7f1adc008790 tx=0x7f1adc00fcb0).ready entity=mon.0 client_cookie=8dc7f878cff61af4 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:10.214 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.208+0000 7f1af0d10700 1 --2- 172.21.15.50:0/2535515955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aec0898b0 0x7f1aec081170 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7f1adc008790 tx=0x7f1adc00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:10.214 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.208+0000 7f1ae3fff700 1 -- 172.21.15.50:0/2535515955 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f1adc011330 con 0x7f1aec0898b0 2019-12-19T22:08:10.214 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.208+0000 7f1af0d10700 1 --2- 172.21.15.50:0/2535515955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aec0898b0 0x7f1aec081170 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7f1adc008790 tx=0x7f1adc00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:10.214 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.208+0000 7f1af0d10700 1 --2- 172.21.15.50:0/2535515955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aec0898b0 0x7f1aec081170 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7f1adc008790 tx=0x7f1adc00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:10.214 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.208+0000 7f1ae3fff700 1 -- 172.21.15.50:0/2535515955 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1adc011530 con 0x7f1aec0898b0 2019-12-19T22:08:10.214 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.208+0000 7f1ae3fff700 1 -- 172.21.15.50:0/2535515955 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f1adc011850 con 0x7f1aec0898b0 2019-12-19T22:08:10.214 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.208+0000 7f1af2f74700 1 -- 172.21.15.50:0/2535515955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aec0898b0 msgr2=0x7f1aec081170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:10.215 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.208+0000 7f1af2f74700 1 --2- 172.21.15.50:0/2535515955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aec0898b0 0x7f1aec081170 secure :-1 s=READY pgs=115 cs=0 l=1 rx=0x7f1adc008790 tx=0x7f1adc00fcb0).stop 2019-12-19T22:08:10.215 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.208+0000 7f1af2f74700 1 -- 172.21.15.50:0/2535515955 shutdown_connections 2019-12-19T22:08:10.215 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.208+0000 7f1af2f74700 1 --2- 172.21.15.50:0/2535515955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aec0898b0 0x7f1aec081170 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:10.215 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.208+0000 7f1af2f74700 1 -- 172.21.15.50:0/2535515955 shutdown_connections 2019-12-19T22:08:10.215 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.208+0000 7f1af2f74700 1 -- 172.21.15.50:0/2535515955 wait complete. 2019-12-19T22:08:10.215 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.208+0000 7f1af2f74700 1 -- 172.21.15.50:0/2535515955 >> 172.21.15.50:0/2535515955 conn(0x7f1aec067e70 msgr2=0x7f1aec094570 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:10.215 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.209+0000 7f1af2f74700 1 Processor -- start 2019-12-19T22:08:10.215 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.209+0000 7f1af2f74700 1 -- start start 2019-12-19T22:08:10.219 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.210+0000 7f1af2f74700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1aec1219e0 0x7f1aec123e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:10.219 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.210+0000 7f1af2f74700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aec0845c0 con 0x7f1aec0824d0 2019-12-19T22:08:10.219 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.210+0000 7f1af2f74700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aec0892b0 con 0x7f1aec1219e0 2019-12-19T22:08:10.219 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.210+0000 7f1af0d10700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1aec1219e0 0x7f1aec123e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:10.220 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.210+0000 7f1af1511700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1aec0824d0 0x7f1aec082900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39742/0 (socket says 172.21.15.50:39742) 2019-12-19T22:08:10.220 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.210+0000 7f1af1511700 1 -- 172.21.15.50:0/1807335989 learned_addr learned my addr 172.21.15.50:0/1807335989 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:10.220 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.210+0000 7f1af0d10700 1 -- 172.21.15.50:0/1807335989 >> v1:172.21.15.50:6789/0 conn(0x7f1aec0824d0 legacy=0x7f1aec082900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:10.220 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.210+0000 7f1af0d10700 1 -- 172.21.15.50:0/1807335989 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aec083db0 con 0x7f1aec1219e0 2019-12-19T22:08:10.222 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.210+0000 7f1ae1ffb700 1 -- 172.21.15.50:0/1807335989 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2800819443 0 0) 0x7f1aec0845c0 con 0x7f1aec0824d0 2019-12-19T22:08:10.222 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.210+0000 7f1af0d10700 1 --2- 172.21.15.50:0/1807335989 >> v2:172.21.15.50:3300/0 conn(0x7f1aec1219e0 0x7f1aec123e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1adc008790 tx=0x7f1adc00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:10.222 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.210+0000 7f1af0d10700 1 --2- 172.21.15.50:0/1807335989 >> v2:172.21.15.50:3300/0 conn(0x7f1aec1219e0 0x7f1aec123e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1adc008790 tx=0x7f1adc00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:10.222 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.210+0000 7f1af0d10700 1 --2- 172.21.15.50:0/1807335989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aec1219e0 0x7f1aec123e20 secure :-1 s=READY pgs=117 cs=0 l=1 rx=0x7f1adc008790 tx=0x7f1adc00f780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:10.222 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.210+0000 7f1af0d10700 1 --2- 172.21.15.50:0/1807335989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aec1219e0 0x7f1aec123e20 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f1adc008790 tx=0x7f1adc00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:10.223 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.210+0000 7f1ae1ffb700 1 -- 172.21.15.50:0/1807335989 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f1adc007280 con 0x7f1aec1219e0 2019-12-19T22:08:10.223 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.210+0000 7f1af0d10700 1 --2- 172.21.15.50:0/1807335989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aec1219e0 0x7f1aec123e20 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f1adc008790 tx=0x7f1adc00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:10.223 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.210+0000 7f1af0d10700 1 --2- 172.21.15.50:0/1807335989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aec1219e0 0x7f1aec123e20 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f1adc008790 tx=0x7f1adc00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:10.223 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.210+0000 7f1ae1ffb700 1 -- 172.21.15.50:0/1807335989 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1adc0115c0 con 0x7f1aec1219e0 2019-12-19T22:08:10.223 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.210+0000 7f1af2f74700 1 -- 172.21.15.50:0/1807335989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aec085d80 con 0x7f1aec1219e0 2019-12-19T22:08:10.223 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.210+0000 7f1ae1ffb700 1 -- 172.21.15.50:0/1807335989 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f1adc0118e0 con 0x7f1aec1219e0 2019-12-19T22:08:10.223 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.211+0000 7f1af2f74700 1 -- 172.21.15.50:0/1807335989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aec085440 con 0x7f1aec1219e0 2019-12-19T22:08:10.224 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.211+0000 7f1af0d10700 1 --2- 172.21.15.50:0/1807335989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aec1219e0 0x7f1aec123e20 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f1adc008790 tx=0x7f1adc00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:10.224 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.211+0000 7f1ae1ffb700 1 -- 172.21.15.50:0/1807335989 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7f1adc005540 con 0x7f1aec1219e0 2019-12-19T22:08:10.224 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.211+0000 7f1af0d10700 1 --2- 172.21.15.50:0/1807335989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aec1219e0 0x7f1aec123e20 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f1adc008790 tx=0x7f1adc00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:10.224 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.211+0000 7f1ae1ffb700 1 --2- 172.21.15.50:0/1807335989 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f1acc01f9f0 0x7f1acc021f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:10.224 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.211+0000 7f1ae1ffb700 1 -- 172.21.15.50:0/1807335989 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3403+0+0 (secure 0 0 0) 0x7f1adc02aa20 con 0x7f1aec1219e0 2019-12-19T22:08:10.224 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.211+0000 7f1af1511700 1 --2- 172.21.15.50:0/1807335989 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f1acc01f9f0 0x7f1acc021f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:10.225 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.211+0000 7f1af1511700 1 --2- 172.21.15.50:0/1807335989 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f1acc01f9f0 0x7f1acc021f00 crc :-1 s=READY pgs=28 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:10.225 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.211+0000 7f1af2f74700 1 -- 172.21.15.50:0/1807335989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aec056340 con 0x7f1aec1219e0 2019-12-19T22:08:10.225 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.215+0000 7f1af0d10700 1 --2- 172.21.15.50:0/1807335989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aec1219e0 0x7f1aec123e20 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f1adc008790 tx=0x7f1adc00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:10.225 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.215+0000 7f1ae1ffb700 1 -- 172.21.15.50:0/1807335989 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7f1adc005d70 con 0x7f1aec1219e0 2019-12-19T22:08:10.388 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.385+0000 7f1af2f74700 1 -- 172.21.15.50:0/1807335989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f1aec086060 con 0x7f1aec1219e0 2019-12-19T22:08:10.389 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.386+0000 7f1af0d10700 1 --2- 172.21.15.50:0/1807335989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aec1219e0 0x7f1aec123e20 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f1adc008790 tx=0x7f1adc00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:10.389 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.387+0000 7f1ae1ffb700 1 -- 172.21.15.50:0/1807335989 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v3) v1 ==== 74+0+48312 (secure 0 0 0) 0x7f1adc005850 con 0x7f1aec1219e0 2019-12-19T22:08:10.390 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:08:10.391 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.388+0000 7f1af2f74700 1 -- 172.21.15.50:0/1807335989 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f1acc01f9f0 msgr2=0x7f1acc021f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:10.391 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.388+0000 7f1af2f74700 1 --2- 172.21.15.50:0/1807335989 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f1acc01f9f0 0x7f1acc021f00 crc :-1 s=READY pgs=28 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:10.391 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.388+0000 7f1af2f74700 1 -- 172.21.15.50:0/1807335989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aec1219e0 msgr2=0x7f1aec123e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:10.391 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.388+0000 7f1af2f74700 1 --2- 172.21.15.50:0/1807335989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aec1219e0 0x7f1aec123e20 secure :-1 s=READY pgs=117 cs=0 l=1 rx=0x7f1adc008790 tx=0x7f1adc00f780).stop 2019-12-19T22:08:10.391 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.388+0000 7f1af2f74700 1 -- 172.21.15.50:0/1807335989 shutdown_connections 2019-12-19T22:08:10.391 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.388+0000 7f1af2f74700 1 --2- 172.21.15.50:0/1807335989 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f1acc01f9f0 0x7f1acc021f00 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:10.392 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.388+0000 7f1af2f74700 1 --2- 172.21.15.50:0/1807335989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aec1219e0 0x7f1aec123e20 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:10.392 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.388+0000 7f1af2f74700 1 -- 172.21.15.50:0/1807335989 shutdown_connections 2019-12-19T22:08:10.392 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.388+0000 7f1af2f74700 1 -- 172.21.15.50:0/1807335989 wait complete. 2019-12-19T22:08:10.392 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.388+0000 7f1af2f74700 1 -- 172.21.15.50:0/1807335989 >> 172.21.15.50:0/1807335989 conn(0x7f1aec091150 msgr2=0x7f1aec07ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:10.401 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":3,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":27190},{"type":"v1","addr":"172.21.15.50:6825","nonce":27190}]},"active_addr":"172.21.15.50:6825/27190","active_change":"2019-12-19T22:07:55.882102+0000","active_mgr_features":4540138292836696063,"available":true,"standbys":[],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"str","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"ca_bundle":{"name":"ca_bundle","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_location":{"name":"server_location","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"1","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"inventory_cache_timeout":{"name":"inventory_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"service_cache_timeout":{"name":"service_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"str","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"str","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"str","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["ansible","cephadm","deepsea","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator_cli","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[]}} 2019-12-19T22:08:10.407 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2019-12-19T22:08:10.407 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2019-12-19T22:08:10.408 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-12-19T22:08:10.532 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.519+0000 7fc9d5b83700 1 Processor -- start 2019-12-19T22:08:10.533 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.519+0000 7fc9d5b83700 1 -- start start 2019-12-19T22:08:10.533 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.519+0000 7fc9d5b83700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc9d0089480 0x7fc9d00898b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:10.533 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.519+0000 7fc9d5b83700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9d008edb0 con 0x7fc9d008f3d0 2019-12-19T22:08:10.533 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.519+0000 7fc9d5b83700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9d008ae60 con 0x7fc9d0089480 2019-12-19T22:08:10.533 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.519+0000 7fc9cffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc9d0089480 0x7fc9d00898b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:10.535 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.519+0000 7fc9cffff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc9d0089480 0x7fc9d00898b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53620/0 (socket says 172.21.15.50:53620) 2019-12-19T22:08:10.535 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.519+0000 7fc9cffff700 1 -- 172.21.15.50:0/2574815301 learned_addr learned my addr 172.21.15.50:0/2574815301 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:10.535 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.520+0000 7fc9cffff700 1 -- 172.21.15.50:0/2574815301 >> v1:172.21.15.50:6789/0 conn(0x7fc9d008f3d0 legacy=0x7fc9d0081170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:10.535 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.520+0000 7fc9cffff700 1 -- 172.21.15.50:0/2574815301 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d0081970 con 0x7fc9d0089480 2019-12-19T22:08:10.535 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.520+0000 7fc9cffff700 1 --2- 172.21.15.50:0/2574815301 >> v2:172.21.15.50:3300/0 conn(0x7fc9d0089480 0x7fc9d00898b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc9c0008790 tx=0x7fc9c000fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:10.535 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.520+0000 7fc9cffff700 1 --2- 172.21.15.50:0/2574815301 >> v2:172.21.15.50:3300/0 conn(0x7fc9d0089480 0x7fc9d00898b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc9c0008790 tx=0x7fc9c000fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:10.536 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.520+0000 7fc9cffff700 1 --2- 172.21.15.50:0/2574815301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9d0089480 0x7fc9d00898b0 secure :-1 s=READY pgs=119 cs=0 l=1 rx=0x7fc9c0008790 tx=0x7fc9c000fcb0).ready entity=mon.0 client_cookie=a0dd325fb0ba204d server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:10.536 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.520+0000 7fc9cffff700 1 --2- 172.21.15.50:0/2574815301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9d0089480 0x7fc9d00898b0 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7fc9c0008790 tx=0x7fc9c000fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:10.536 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.520+0000 7fc9cf7fe700 1 -- 172.21.15.50:0/2574815301 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fc9c0011330 con 0x7fc9d0089480 2019-12-19T22:08:10.536 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.520+0000 7fc9cffff700 1 --2- 172.21.15.50:0/2574815301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9d0089480 0x7fc9d00898b0 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7fc9c0008790 tx=0x7fc9c000fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:10.538 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.520+0000 7fc9cffff700 1 --2- 172.21.15.50:0/2574815301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9d0089480 0x7fc9d00898b0 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7fc9c0008790 tx=0x7fc9c000fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:10.538 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.520+0000 7fc9cf7fe700 1 -- 172.21.15.50:0/2574815301 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c0011530 con 0x7fc9d0089480 2019-12-19T22:08:10.538 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.520+0000 7fc9cf7fe700 1 -- 172.21.15.50:0/2574815301 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fc9c0011850 con 0x7fc9d0089480 2019-12-19T22:08:10.538 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.520+0000 7fc9d5b83700 1 -- 172.21.15.50:0/2574815301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9d0089480 msgr2=0x7fc9d00898b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:10.539 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.520+0000 7fc9d5b83700 1 --2- 172.21.15.50:0/2574815301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9d0089480 0x7fc9d00898b0 secure :-1 s=READY pgs=119 cs=0 l=1 rx=0x7fc9c0008790 tx=0x7fc9c000fcb0).stop 2019-12-19T22:08:10.539 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.520+0000 7fc9d5b83700 1 -- 172.21.15.50:0/2574815301 shutdown_connections 2019-12-19T22:08:10.539 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.520+0000 7fc9d5b83700 1 --2- 172.21.15.50:0/2574815301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9d0089480 0x7fc9d00898b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:10.539 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.520+0000 7fc9d5b83700 1 -- 172.21.15.50:0/2574815301 shutdown_connections 2019-12-19T22:08:10.539 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.521+0000 7fc9d5b83700 1 -- 172.21.15.50:0/2574815301 wait complete. 2019-12-19T22:08:10.539 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.521+0000 7fc9d5b83700 1 -- 172.21.15.50:0/2574815301 >> 172.21.15.50:0/2574815301 conn(0x7fc9d0067e70 msgr2=0x7fc9d0094570 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:10.539 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.521+0000 7fc9d5b83700 1 Processor -- start 2019-12-19T22:08:10.540 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.521+0000 7fc9d5b83700 1 -- start start 2019-12-19T22:08:10.540 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.522+0000 7fc9d5b83700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc9d0121910 0x7fc9d0123d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:10.540 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.522+0000 7fc9d5b83700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9d0061f20 con 0x7fc9d011e6c0 2019-12-19T22:08:10.540 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.522+0000 7fc9d5b83700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9d0061010 con 0x7fc9d0121910 2019-12-19T22:08:10.540 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.522+0000 7fc9c7fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc9d0121910 0x7fc9d0123d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:10.540 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.522+0000 7fc9cffff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc9d011e6c0 0x7fc9d011eaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39752/0 (socket says 172.21.15.50:39752) 2019-12-19T22:08:10.540 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.522+0000 7fc9cffff700 1 -- 172.21.15.50:0/1274737308 learned_addr learned my addr 172.21.15.50:0/1274737308 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:10.541 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.522+0000 7fc9cd7fa700 1 -- 172.21.15.50:0/1274737308 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2347725174 0 0) 0x7fc9d0061f20 con 0x7fc9d011e6c0 2019-12-19T22:08:10.541 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.522+0000 7fc9cd7fa700 1 -- 172.21.15.50:0/1274737308 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9b40030b0 con 0x7fc9d011e6c0 2019-12-19T22:08:10.541 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.522+0000 7fc9c7fff700 1 -- 172.21.15.50:0/1274737308 >> v1:172.21.15.50:6789/0 conn(0x7fc9d011e6c0 legacy=0x7fc9d011eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:10.541 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.522+0000 7fc9c7fff700 1 -- 172.21.15.50:0/1274737308 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d0063100 con 0x7fc9d0121910 2019-12-19T22:08:10.541 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.522+0000 7fc9c7fff700 1 --2- 172.21.15.50:0/1274737308 >> v2:172.21.15.50:3300/0 conn(0x7fc9d0121910 0x7fc9d0123d50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc9b8000b80 tx=0x7fc9b800c2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:10.541 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.522+0000 7fc9c7fff700 1 --2- 172.21.15.50:0/1274737308 >> v2:172.21.15.50:3300/0 conn(0x7fc9d0121910 0x7fc9d0123d50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc9b8000b80 tx=0x7fc9b800c2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:10.541 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.522+0000 7fc9c7fff700 1 --2- 172.21.15.50:0/1274737308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9d0121910 0x7fc9d0123d50 secure :-1 s=READY pgs=121 cs=0 l=1 rx=0x7fc9b8000b80 tx=0x7fc9b800c2f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:10.542 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.523+0000 7fc9c7fff700 1 --2- 172.21.15.50:0/1274737308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9d0121910 0x7fc9d0123d50 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7fc9b8000b80 tx=0x7fc9b800c2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:10.542 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.523+0000 7fc9cd7fa700 1 -- 172.21.15.50:0/1274737308 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fc9b800ca10 con 0x7fc9d0121910 2019-12-19T22:08:10.542 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.523+0000 7fc9c7fff700 1 --2- 172.21.15.50:0/1274737308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9d0121910 0x7fc9d0123d50 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7fc9b8000b80 tx=0x7fc9b800c2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:10.542 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.523+0000 7fc9d5b83700 1 -- 172.21.15.50:0/1274737308 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9d0063580 con 0x7fc9d0121910 2019-12-19T22:08:10.542 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.523+0000 7fc9cd7fa700 1 -- 172.21.15.50:0/1274737308 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b800cc10 con 0x7fc9d0121910 2019-12-19T22:08:10.542 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.523+0000 7fc9c7fff700 1 --2- 172.21.15.50:0/1274737308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9d0121910 0x7fc9d0123d50 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7fc9b8000b80 tx=0x7fc9b800c2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:10.552 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.523+0000 7fc9cd7fa700 1 -- 172.21.15.50:0/1274737308 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fc9b8010e00 con 0x7fc9d0121910 2019-12-19T22:08:10.553 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.523+0000 7fc9d5b83700 1 -- 172.21.15.50:0/1274737308 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9d0061800 con 0x7fc9d0121910 2019-12-19T22:08:10.553 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.523+0000 7fc9c7fff700 1 --2- 172.21.15.50:0/1274737308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9d0121910 0x7fc9d0123d50 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7fc9b8000b80 tx=0x7fc9b800c2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:10.553 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.523+0000 7fc9cd7fa700 1 -- 172.21.15.50:0/1274737308 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7fc9b8007430 con 0x7fc9d0121910 2019-12-19T22:08:10.553 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.523+0000 7fc9c7fff700 1 --2- 172.21.15.50:0/1274737308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9d0121910 0x7fc9d0123d50 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7fc9b8000b80 tx=0x7fc9b800c2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:10.553 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.523+0000 7fc9cd7fa700 1 --2- 172.21.15.50:0/1274737308 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fc9b401ff70 0x7fc9b4022480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:10.553 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.523+0000 7fc9cd7fa700 1 -- 172.21.15.50:0/1274737308 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3403+0+0 (secure 0 0 0) 0x7fc9b802a420 con 0x7fc9d0121910 2019-12-19T22:08:10.553 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.523+0000 7fc9cffff700 1 --2- 172.21.15.50:0/1274737308 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fc9b401ff70 0x7fc9b4022480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:10.554 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.524+0000 7fc9cffff700 1 --2- 172.21.15.50:0/1274737308 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fc9b401ff70 0x7fc9b4022480 crc :-1 s=READY pgs=29 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:10.554 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.524+0000 7fc9d5b83700 1 -- 172.21.15.50:0/1274737308 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9d0056340 con 0x7fc9d0121910 2019-12-19T22:08:10.554 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.527+0000 7fc9c7fff700 1 --2- 172.21.15.50:0/1274737308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9d0121910 0x7fc9d0123d50 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7fc9b8000b80 tx=0x7fc9b800c2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:10.554 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.527+0000 7fc9cd7fa700 1 -- 172.21.15.50:0/1274737308 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7fc9b8007740 con 0x7fc9d0121910 2019-12-19T22:08:10.665 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.663+0000 7fc9d5b83700 1 -- 172.21.15.50:0/1274737308 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9d011f4b0 con 0x7fc9d0121910 2019-12-19T22:08:10.666 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.664+0000 7fc9c7fff700 1 --2- 172.21.15.50:0/1274737308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9d0121910 0x7fc9d0123d50 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7fc9b8000b80 tx=0x7fc9b800c2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:10.666 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.664+0000 7fc9cd7fa700 1 -- 172.21.15.50:0/1274737308 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+8801 (secure 0 0 0) 0x7fc9b8007c60 con 0x7fc9d0121910 2019-12-19T22:08:10.666 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:08:10.667 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":17,"fsid":"c1382993-41cc-4b35-a402-c17778701f01","created":"2019-12-19T22:07:52.345475+0000","modified":"2019-12-19T22:08:07.711207+0000","last_up_change":"2019-12-19T22:07:58.357117+0000","last_in_change":"2019-12-19T22:07:58.357117+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-19T22:08:01.570202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2019-12-19T22:08:04.515784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2019-12-19T22:08:05.689151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6137ed8c-8e2c-4e88-8634-dc763bed14c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":27757},{"type":"v1","addr":"172.21.15.50:6817","nonce":27757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":27757},{"type":"v1","addr":"172.21.15.50:6819","nonce":27757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":27757},{"type":"v1","addr":"172.21.15.50:6823","nonce":27757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":27757},{"type":"v1","addr":"172.21.15.50:6821","nonce":27757}]},"public_addr":"172.21.15.50:6817/27757","cluster_addr":"172.21.15.50:6819/27757","heartbeat_back_addr":"172.21.15.50:6823/27757","heartbeat_front_addr":"172.21.15.50:6821/27757","state":["exists","up"]},{"osd":1,"uuid":"57d4e31d-408e-4302-859d-7ea672b93772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":27758},{"type":"v1","addr":"172.21.15.50:6801","nonce":27758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":27758},{"type":"v1","addr":"172.21.15.50:6803","nonce":27758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":27758},{"type":"v1","addr":"172.21.15.50:6810","nonce":27758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6805","nonce":27758},{"type":"v1","addr":"172.21.15.50:6807","nonce":27758}]},"public_addr":"172.21.15.50:6801/27758","cluster_addr":"172.21.15.50:6803/27758","heartbeat_back_addr":"172.21.15.50:6810/27758","heartbeat_front_addr":"172.21.15.50:6807/27758","state":["exists","up"]},{"osd":2,"uuid":"600ea585-aa50-4596-9b14-090eab15f9a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":27759},{"type":"v1","addr":"172.21.15.50:6806","nonce":27759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":27759},{"type":"v1","addr":"172.21.15.50:6811","nonce":27759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":27759},{"type":"v1","addr":"172.21.15.50:6816","nonce":27759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":27759},{"type":"v1","addr":"172.21.15.50:6813","nonce":27759}]},"public_addr":"172.21.15.50:6806/27759","cluster_addr":"172.21.15.50:6811/27759","heartbeat_back_addr":"172.21.15.50:6816/27759","heartbeat_front_addr":"172.21.15.50:6813/27759","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-19T22:07:56.415731+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-19T22:07:56.346062+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-19T22:07:56.090889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-19T22:08:10.668 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.665+0000 7fc9d5b83700 1 -- 172.21.15.50:0/1274737308 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fc9b401ff70 msgr2=0x7fc9b4022480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:10.668 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.665+0000 7fc9d5b83700 1 --2- 172.21.15.50:0/1274737308 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fc9b401ff70 0x7fc9b4022480 crc :-1 s=READY pgs=29 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:10.668 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.665+0000 7fc9d5b83700 1 -- 172.21.15.50:0/1274737308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9d0121910 msgr2=0x7fc9d0123d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:10.668 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.665+0000 7fc9d5b83700 1 --2- 172.21.15.50:0/1274737308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9d0121910 0x7fc9d0123d50 secure :-1 s=READY pgs=121 cs=0 l=1 rx=0x7fc9b8000b80 tx=0x7fc9b800c2f0).stop 2019-12-19T22:08:10.669 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.665+0000 7fc9d5b83700 1 -- 172.21.15.50:0/1274737308 shutdown_connections 2019-12-19T22:08:10.669 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.665+0000 7fc9d5b83700 1 --2- 172.21.15.50:0/1274737308 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fc9b401ff70 0x7fc9b4022480 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:10.669 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.665+0000 7fc9d5b83700 1 --2- 172.21.15.50:0/1274737308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9d0121910 0x7fc9d0123d50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:10.669 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.665+0000 7fc9d5b83700 1 -- 172.21.15.50:0/1274737308 shutdown_connections 2019-12-19T22:08:10.669 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.665+0000 7fc9d5b83700 1 -- 172.21.15.50:0/1274737308 wait complete. 2019-12-19T22:08:10.669 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.665+0000 7fc9d5b83700 1 -- 172.21.15.50:0/1274737308 >> 172.21.15.50:0/1274737308 conn(0x7fc9d0081c40 msgr2=0x7fc9d008bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:10.678 INFO:tasks.ceph.ceph_manager.ceph:all up! 2019-12-19T22:08:10.678 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-12-19T22:08:10.801 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.789+0000 7f0aa1ae3700 1 Processor -- start 2019-12-19T22:08:10.801 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.789+0000 7f0aa1ae3700 1 -- start start 2019-12-19T22:08:10.801 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.790+0000 7f0aa1ae3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0a9c0898b0 0x7f0a9c081170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:10.801 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.790+0000 7f0aa1ae3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a9c089ce0 con 0x7f0a9c089480 2019-12-19T22:08:10.801 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.790+0000 7f0aa1ae3700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a9c08ae60 con 0x7f0a9c0898b0 2019-12-19T22:08:10.802 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.790+0000 7f0a93fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0a9c0898b0 0x7f0a9c081170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:10.802 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.790+0000 7f0a9bfff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0a9c089480 0x7f0a9c08f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39758/0 (socket says 172.21.15.50:39758) 2019-12-19T22:08:10.802 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.790+0000 7f0a9bfff700 1 -- 172.21.15.50:0/3753136939 learned_addr learned my addr 172.21.15.50:0/3753136939 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:10.802 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.790+0000 7f0a93fff700 1 -- 172.21.15.50:0/3753136939 >> v1:172.21.15.50:6789/0 conn(0x7f0a9c089480 legacy=0x7f0a9c08f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:10.802 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.790+0000 7f0a93fff700 1 -- 172.21.15.50:0/3753136939 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a9c08edb0 con 0x7f0a9c0898b0 2019-12-19T22:08:10.802 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.790+0000 7f0a93fff700 1 --2- 172.21.15.50:0/3753136939 >> v2:172.21.15.50:3300/0 conn(0x7f0a9c0898b0 0x7f0a9c081170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0a84008790 tx=0x7f0a8400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:10.802 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.790+0000 7f0a93fff700 1 --2- 172.21.15.50:0/3753136939 >> v2:172.21.15.50:3300/0 conn(0x7f0a9c0898b0 0x7f0a9c081170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0a84008790 tx=0x7f0a8400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:10.803 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.790+0000 7f0a93fff700 1 --2- 172.21.15.50:0/3753136939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a9c0898b0 0x7f0a9c081170 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7f0a84008790 tx=0x7f0a8400fbf0).ready entity=mon.0 client_cookie=27f012e865131cf9 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:10.803 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.790+0000 7f0a93fff700 1 --2- 172.21.15.50:0/3753136939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a9c0898b0 0x7f0a9c081170 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7f0a84008790 tx=0x7f0a8400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:10.803 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.790+0000 7f0a93fff700 1 --2- 172.21.15.50:0/3753136939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a9c0898b0 0x7f0a9c081170 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7f0a84008790 tx=0x7f0a8400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:10.803 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.790+0000 7f0a9b7fe700 1 -- 172.21.15.50:0/3753136939 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f0a84011270 con 0x7f0a9c0898b0 2019-12-19T22:08:10.803 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.790+0000 7f0a93fff700 1 --2- 172.21.15.50:0/3753136939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a9c0898b0 0x7f0a9c081170 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7f0a84008790 tx=0x7f0a8400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:10.803 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.790+0000 7f0a9b7fe700 1 -- 172.21.15.50:0/3753136939 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a84011470 con 0x7f0a9c0898b0 2019-12-19T22:08:10.803 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.790+0000 7f0a9b7fe700 1 -- 172.21.15.50:0/3753136939 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f0a840117d0 con 0x7f0a9c0898b0 2019-12-19T22:08:10.804 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.790+0000 7f0aa1ae3700 1 -- 172.21.15.50:0/3753136939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a9c0898b0 msgr2=0x7f0a9c081170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:10.804 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.790+0000 7f0aa1ae3700 1 --2- 172.21.15.50:0/3753136939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a9c0898b0 0x7f0a9c081170 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7f0a84008790 tx=0x7f0a8400fbf0).stop 2019-12-19T22:08:10.804 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.791+0000 7f0aa1ae3700 1 -- 172.21.15.50:0/3753136939 shutdown_connections 2019-12-19T22:08:10.804 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.791+0000 7f0aa1ae3700 1 --2- 172.21.15.50:0/3753136939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a9c0898b0 0x7f0a9c081170 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:10.806 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.791+0000 7f0aa1ae3700 1 -- 172.21.15.50:0/3753136939 shutdown_connections 2019-12-19T22:08:10.806 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.791+0000 7f0aa1ae3700 1 -- 172.21.15.50:0/3753136939 wait complete. 2019-12-19T22:08:10.807 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.791+0000 7f0aa1ae3700 1 -- 172.21.15.50:0/3753136939 >> 172.21.15.50:0/3753136939 conn(0x7f0a9c067e70 msgr2=0x7f0a9c094570 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:10.807 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.792+0000 7f0aa1ae3700 1 Processor -- start 2019-12-19T22:08:10.807 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.792+0000 7f0aa1ae3700 1 -- start start 2019-12-19T22:08:10.807 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.792+0000 7f0aa1ae3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0a9c122b50 0x7f0a9c124f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:10.807 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.792+0000 7f0aa1ae3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a9c0874b0 con 0x7f0a9c11f830 2019-12-19T22:08:10.807 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.792+0000 7f0aa1ae3700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a9c090a20 con 0x7f0a9c122b50 2019-12-19T22:08:10.807 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.792+0000 7f0a9bfff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0a9c11f830 0x7f0a9c11fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39762/0 (socket says 172.21.15.50:39762) 2019-12-19T22:08:10.808 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.792+0000 7f0a9bfff700 1 -- 172.21.15.50:0/4274207989 learned_addr learned my addr 172.21.15.50:0/4274207989 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:10.808 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.792+0000 7f0a93fff700 1 --2- 172.21.15.50:0/4274207989 >> v2:172.21.15.50:3300/0 conn(0x7f0a9c122b50 0x7f0a9c124f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:10.808 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.793+0000 7f0a93fff700 1 -- 172.21.15.50:0/4274207989 >> v1:172.21.15.50:6789/0 conn(0x7f0a9c11f830 legacy=0x7f0a9c11fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:10.808 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.793+0000 7f0a93fff700 1 -- 172.21.15.50:0/4274207989 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a9c085ac0 con 0x7f0a9c122b50 2019-12-19T22:08:10.808 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.793+0000 7f0a93fff700 1 --2- 172.21.15.50:0/4274207989 >> v2:172.21.15.50:3300/0 conn(0x7f0a9c122b50 0x7f0a9c124f90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0a8c0010f0 tx=0x7f0a8c001130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:10.808 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.793+0000 7f0a93fff700 1 --2- 172.21.15.50:0/4274207989 >> v2:172.21.15.50:3300/0 conn(0x7f0a9c122b50 0x7f0a9c124f90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0a8c0010f0 tx=0x7f0a8c001130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:10.809 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.793+0000 7f0a93fff700 1 --2- 172.21.15.50:0/4274207989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a9c122b50 0x7f0a9c124f90 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7f0a8c0010f0 tx=0x7f0a8c001130).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:10.809 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.793+0000 7f0a93fff700 1 --2- 172.21.15.50:0/4274207989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a9c122b50 0x7f0a9c124f90 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f0a8c0010f0 tx=0x7f0a8c001130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:10.809 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.793+0000 7f0a997fa700 1 -- 172.21.15.50:0/4274207989 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f0a84007150 con 0x7f0a9c122b50 2019-12-19T22:08:10.809 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.793+0000 7f0a93fff700 1 --2- 172.21.15.50:0/4274207989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a9c122b50 0x7f0a9c124f90 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f0a8c0010f0 tx=0x7f0a8c001130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:10.809 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.793+0000 7f0a93fff700 1 --2- 172.21.15.50:0/4274207989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a9c122b50 0x7f0a9c124f90 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f0a8c0010f0 tx=0x7f0a8c001130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:10.809 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.793+0000 7f0a997fa700 1 -- 172.21.15.50:0/4274207989 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a84007350 con 0x7f0a9c122b50 2019-12-19T22:08:10.810 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.793+0000 7f0a997fa700 1 -- 172.21.15.50:0/4274207989 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f0a84011480 con 0x7f0a9c122b50 2019-12-19T22:08:10.810 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.793+0000 7f0aa1ae3700 1 -- 172.21.15.50:0/4274207989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a9c086590 con 0x7f0a9c122b50 2019-12-19T22:08:10.810 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.793+0000 7f0aa1ae3700 1 -- 172.21.15.50:0/4274207989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a9c087100 con 0x7f0a9c122b50 2019-12-19T22:08:10.810 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.793+0000 7f0a93fff700 1 --2- 172.21.15.50:0/4274207989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a9c122b50 0x7f0a9c124f90 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f0a8c0010f0 tx=0x7f0a8c001130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:10.810 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.794+0000 7f0a997fa700 1 -- 172.21.15.50:0/4274207989 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7f0a840116d0 con 0x7f0a9c122b50 2019-12-19T22:08:10.811 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.794+0000 7f0a93fff700 1 --2- 172.21.15.50:0/4274207989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a9c122b50 0x7f0a9c124f90 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f0a8c0010f0 tx=0x7f0a8c001130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:10.811 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.794+0000 7f0a997fa700 1 --2- 172.21.15.50:0/4274207989 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f0a8001fa60 0x7f0a80021f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:10.811 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.794+0000 7f0a997fa700 1 -- 172.21.15.50:0/4274207989 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3403+0+0 (secure 0 0 0) 0x7f0a8402aa20 con 0x7f0a9c122b50 2019-12-19T22:08:10.811 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.794+0000 7f0a9bfff700 1 --2- 172.21.15.50:0/4274207989 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f0a8001fa60 0x7f0a80021f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:10.811 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.794+0000 7f0a9bfff700 1 --2- 172.21.15.50:0/4274207989 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f0a8001fa60 0x7f0a80021f70 crc :-1 s=READY pgs=30 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:10.811 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.794+0000 7f0aa1ae3700 1 -- 172.21.15.50:0/4274207989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a9c056340 con 0x7f0a9c122b50 2019-12-19T22:08:10.811 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.797+0000 7f0a93fff700 1 --2- 172.21.15.50:0/4274207989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a9c122b50 0x7f0a9c124f90 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f0a8c0010f0 tx=0x7f0a8c001130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:10.812 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.797+0000 7f0a997fa700 1 -- 172.21.15.50:0/4274207989 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7f0a8400ddc0 con 0x7f0a9c122b50 2019-12-19T22:08:10.938 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.936+0000 7f0aa1ae3700 1 -- 172.21.15.50:0/4274207989 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a9c082200 con 0x7f0a9c122b50 2019-12-19T22:08:10.939 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.936+0000 7f0a93fff700 1 --2- 172.21.15.50:0/4274207989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a9c122b50 0x7f0a9c124f90 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f0a8c0010f0 tx=0x7f0a8c001130).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:10.939 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.936+0000 7f0a997fa700 1 -- 172.21.15.50:0/4274207989 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+8801 (secure 0 0 0) 0x7f0a84005a60 con 0x7f0a9c122b50 2019-12-19T22:08:10.939 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:08:10.940 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":17,"fsid":"c1382993-41cc-4b35-a402-c17778701f01","created":"2019-12-19T22:07:52.345475+0000","modified":"2019-12-19T22:08:07.711207+0000","last_up_change":"2019-12-19T22:07:58.357117+0000","last_in_change":"2019-12-19T22:07:58.357117+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-19T22:08:01.570202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2019-12-19T22:08:04.515784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2019-12-19T22:08:05.689151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6137ed8c-8e2c-4e88-8634-dc763bed14c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":27757},{"type":"v1","addr":"172.21.15.50:6817","nonce":27757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":27757},{"type":"v1","addr":"172.21.15.50:6819","nonce":27757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":27757},{"type":"v1","addr":"172.21.15.50:6823","nonce":27757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":27757},{"type":"v1","addr":"172.21.15.50:6821","nonce":27757}]},"public_addr":"172.21.15.50:6817/27757","cluster_addr":"172.21.15.50:6819/27757","heartbeat_back_addr":"172.21.15.50:6823/27757","heartbeat_front_addr":"172.21.15.50:6821/27757","state":["exists","up"]},{"osd":1,"uuid":"57d4e31d-408e-4302-859d-7ea672b93772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":27758},{"type":"v1","addr":"172.21.15.50:6801","nonce":27758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":27758},{"type":"v1","addr":"172.21.15.50:6803","nonce":27758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":27758},{"type":"v1","addr":"172.21.15.50:6810","nonce":27758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6805","nonce":27758},{"type":"v1","addr":"172.21.15.50:6807","nonce":27758}]},"public_addr":"172.21.15.50:6801/27758","cluster_addr":"172.21.15.50:6803/27758","heartbeat_back_addr":"172.21.15.50:6810/27758","heartbeat_front_addr":"172.21.15.50:6807/27758","state":["exists","up"]},{"osd":2,"uuid":"600ea585-aa50-4596-9b14-090eab15f9a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":27759},{"type":"v1","addr":"172.21.15.50:6806","nonce":27759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":27759},{"type":"v1","addr":"172.21.15.50:6811","nonce":27759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":27759},{"type":"v1","addr":"172.21.15.50:6816","nonce":27759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":27759},{"type":"v1","addr":"172.21.15.50:6813","nonce":27759}]},"public_addr":"172.21.15.50:6806/27759","cluster_addr":"172.21.15.50:6811/27759","heartbeat_back_addr":"172.21.15.50:6816/27759","heartbeat_front_addr":"172.21.15.50:6813/27759","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-19T22:07:56.415731+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-19T22:07:56.346062+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-19T22:07:56.090889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-19T22:08:10.941 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.937+0000 7f0aa1ae3700 1 -- 172.21.15.50:0/4274207989 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f0a8001fa60 msgr2=0x7f0a80021f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:10.942 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.937+0000 7f0aa1ae3700 1 --2- 172.21.15.50:0/4274207989 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f0a8001fa60 0x7f0a80021f70 crc :-1 s=READY pgs=30 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:10.942 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.937+0000 7f0aa1ae3700 1 -- 172.21.15.50:0/4274207989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a9c122b50 msgr2=0x7f0a9c124f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:10.942 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.937+0000 7f0aa1ae3700 1 --2- 172.21.15.50:0/4274207989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a9c122b50 0x7f0a9c124f90 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7f0a8c0010f0 tx=0x7f0a8c001130).stop 2019-12-19T22:08:10.942 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.937+0000 7f0aa1ae3700 1 -- 172.21.15.50:0/4274207989 shutdown_connections 2019-12-19T22:08:10.942 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.937+0000 7f0aa1ae3700 1 --2- 172.21.15.50:0/4274207989 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f0a8001fa60 0x7f0a80021f70 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:10.942 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.937+0000 7f0aa1ae3700 1 --2- 172.21.15.50:0/4274207989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a9c122b50 0x7f0a9c124f90 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:10.942 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.938+0000 7f0aa1ae3700 1 -- 172.21.15.50:0/4274207989 shutdown_connections 2019-12-19T22:08:10.943 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.938+0000 7f0aa1ae3700 1 -- 172.21.15.50:0/4274207989 wait complete. 2019-12-19T22:08:10.943 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:10.938+0000 7f0aa1ae3700 1 -- 172.21.15.50:0/4274207989 >> 172.21.15.50:0/4274207989 conn(0x7f0a9c091150 msgr2=0x7f0a9c07ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:10.951 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2019-12-19T22:08:11.069 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.064+0000 7f1af182a700 1 Processor -- start 2019-12-19T22:08:11.069 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.064+0000 7f1af182a700 1 -- start start 2019-12-19T22:08:11.069 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.064+0000 7f1af182a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1aec089480 0x7f1aec0898b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:11.070 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.064+0000 7f1af182a700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aec08edb0 con 0x7f1aec08f3d0 2019-12-19T22:08:11.070 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.064+0000 7f1af182a700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aec08ae60 con 0x7f1aec089480 2019-12-19T22:08:11.070 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.064+0000 7f1aeb7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1aec089480 0x7f1aec0898b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:11.070 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.065+0000 7f1aeb7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1aec089480 0x7f1aec0898b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53640/0 (socket says 172.21.15.50:53640) 2019-12-19T22:08:11.070 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.065+0000 7f1aeb7fe700 1 -- 172.21.15.50:0/3962085240 learned_addr learned my addr 172.21.15.50:0/3962085240 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:11.070 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.065+0000 7f1aeb7fe700 1 -- 172.21.15.50:0/3962085240 >> v1:172.21.15.50:6789/0 conn(0x7f1aec08f3d0 legacy=0x7f1aec081170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:11.071 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.065+0000 7f1aeb7fe700 1 -- 172.21.15.50:0/3962085240 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aec081970 con 0x7f1aec089480 2019-12-19T22:08:11.071 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.065+0000 7f1aeb7fe700 1 --2- 172.21.15.50:0/3962085240 >> v2:172.21.15.50:3300/0 conn(0x7f1aec089480 0x7f1aec0898b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1adc008790 tx=0x7f1adc00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.071 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.065+0000 7f1aeb7fe700 1 --2- 172.21.15.50:0/3962085240 >> v2:172.21.15.50:3300/0 conn(0x7f1aec089480 0x7f1aec0898b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1adc008790 tx=0x7f1adc00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.071 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.065+0000 7f1aeb7fe700 1 --2- 172.21.15.50:0/3962085240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aec089480 0x7f1aec0898b0 secure :-1 s=READY pgs=127 cs=0 l=1 rx=0x7f1adc008790 tx=0x7f1adc00fcb0).ready entity=mon.0 client_cookie=a08f6287c8e2d27 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:11.071 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.065+0000 7f1aeb7fe700 1 --2- 172.21.15.50:0/3962085240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aec089480 0x7f1aec0898b0 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7f1adc008790 tx=0x7f1adc00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.071 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.065+0000 7f1aeaffd700 1 -- 172.21.15.50:0/3962085240 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f1adc011330 con 0x7f1aec089480 2019-12-19T22:08:11.071 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.065+0000 7f1aeb7fe700 1 --2- 172.21.15.50:0/3962085240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aec089480 0x7f1aec0898b0 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7f1adc008790 tx=0x7f1adc00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.072 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.065+0000 7f1aeb7fe700 1 --2- 172.21.15.50:0/3962085240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aec089480 0x7f1aec0898b0 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7f1adc008790 tx=0x7f1adc00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.072 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.065+0000 7f1aeaffd700 1 -- 172.21.15.50:0/3962085240 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1adc011530 con 0x7f1aec089480 2019-12-19T22:08:11.072 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.065+0000 7f1aeaffd700 1 -- 172.21.15.50:0/3962085240 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f1adc011850 con 0x7f1aec089480 2019-12-19T22:08:11.072 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.065+0000 7f1af182a700 1 -- 172.21.15.50:0/3962085240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aec089480 msgr2=0x7f1aec0898b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:11.072 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.065+0000 7f1af182a700 1 --2- 172.21.15.50:0/3962085240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aec089480 0x7f1aec0898b0 secure :-1 s=READY pgs=127 cs=0 l=1 rx=0x7f1adc008790 tx=0x7f1adc00fcb0).stop 2019-12-19T22:08:11.072 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.066+0000 7f1af182a700 1 -- 172.21.15.50:0/3962085240 shutdown_connections 2019-12-19T22:08:11.072 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.066+0000 7f1af182a700 1 --2- 172.21.15.50:0/3962085240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aec089480 0x7f1aec0898b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:11.073 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.066+0000 7f1af182a700 1 -- 172.21.15.50:0/3962085240 shutdown_connections 2019-12-19T22:08:11.073 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.066+0000 7f1af182a700 1 -- 172.21.15.50:0/3962085240 wait complete. 2019-12-19T22:08:11.073 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.066+0000 7f1af182a700 1 -- 172.21.15.50:0/3962085240 >> 172.21.15.50:0/3962085240 conn(0x7f1aec067e70 msgr2=0x7f1aec094570 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:11.073 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.067+0000 7f1af182a700 1 Processor -- start 2019-12-19T22:08:11.073 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.067+0000 7f1af182a700 1 -- start start 2019-12-19T22:08:11.076 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.067+0000 7f1af182a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1aec122920 0x7f1aec124d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:11.076 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.067+0000 7f1af182a700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aec064690 con 0x7f1aec11f6d0 2019-12-19T22:08:11.076 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.067+0000 7f1af182a700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aec0912f0 con 0x7f1aec122920 2019-12-19T22:08:11.077 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.067+0000 7f1ae2ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f1aec122920 0x7f1aec124d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:11.077 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.067+0000 7f1aeb7fe700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f1aec11f6d0 0x7f1aec11fb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39772/0 (socket says 172.21.15.50:39772) 2019-12-19T22:08:11.077 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.067+0000 7f1aeb7fe700 1 -- 172.21.15.50:0/1623306608 learned_addr learned my addr 172.21.15.50:0/1623306608 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:11.077 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.068+0000 7f1ae2ffd700 1 -- 172.21.15.50:0/1623306608 >> v1:172.21.15.50:6789/0 conn(0x7f1aec11f6d0 legacy=0x7f1aec11fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:11.077 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.068+0000 7f1ae8ff9700 1 -- 172.21.15.50:0/1623306608 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 432768790 0 0) 0x7f1aec064690 con 0x7f1aec11f6d0 2019-12-19T22:08:11.077 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.068+0000 7f1ae2ffd700 1 -- 172.21.15.50:0/1623306608 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aec062c30 con 0x7f1aec122920 2019-12-19T22:08:11.077 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.068+0000 7f1ae2ffd700 1 --2- 172.21.15.50:0/1623306608 >> v2:172.21.15.50:3300/0 conn(0x7f1aec122920 0x7f1aec124d60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1ad40013e0 tx=0x7f1ad400c2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.078 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.068+0000 7f1ae2ffd700 1 --2- 172.21.15.50:0/1623306608 >> v2:172.21.15.50:3300/0 conn(0x7f1aec122920 0x7f1aec124d60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1ad40013e0 tx=0x7f1ad400c2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.078 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.068+0000 7f1ae2ffd700 1 --2- 172.21.15.50:0/1623306608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aec122920 0x7f1aec124d60 secure :-1 s=READY pgs=129 cs=0 l=1 rx=0x7f1ad40013e0 tx=0x7f1ad400c2f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:11.078 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.068+0000 7f1ae2ffd700 1 --2- 172.21.15.50:0/1623306608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aec122920 0x7f1aec124d60 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7f1ad40013e0 tx=0x7f1ad400c2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.078 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.068+0000 7f1ae8ff9700 1 -- 172.21.15.50:0/1623306608 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f1ad400ca10 con 0x7f1aec122920 2019-12-19T22:08:11.078 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.068+0000 7f1ae2ffd700 1 --2- 172.21.15.50:0/1623306608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aec122920 0x7f1aec124d60 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7f1ad40013e0 tx=0x7f1ad400c2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.078 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.068+0000 7f1af182a700 1 -- 172.21.15.50:0/1623306608 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aec062f80 con 0x7f1aec122920 2019-12-19T22:08:11.078 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.068+0000 7f1ae8ff9700 1 -- 172.21.15.50:0/1623306608 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad400cc10 con 0x7f1aec122920 2019-12-19T22:08:11.079 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.068+0000 7f1ae2ffd700 1 --2- 172.21.15.50:0/1623306608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aec122920 0x7f1aec124d60 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7f1ad40013e0 tx=0x7f1ad400c2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.079 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.068+0000 7f1ae8ff9700 1 -- 172.21.15.50:0/1623306608 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f1ad4010e40 con 0x7f1aec122920 2019-12-19T22:08:11.079 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.068+0000 7f1af182a700 1 -- 172.21.15.50:0/1623306608 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aec0636c0 con 0x7f1aec122920 2019-12-19T22:08:11.079 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.068+0000 7f1ae2ffd700 1 --2- 172.21.15.50:0/1623306608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aec122920 0x7f1aec124d60 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7f1ad40013e0 tx=0x7f1ad400c2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.079 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.068+0000 7f1ae8ff9700 1 -- 172.21.15.50:0/1623306608 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7f1ad4007430 con 0x7f1aec122920 2019-12-19T22:08:11.079 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.068+0000 7f1ae2ffd700 1 --2- 172.21.15.50:0/1623306608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aec122920 0x7f1aec124d60 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7f1ad40013e0 tx=0x7f1ad400c2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.079 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.069+0000 7f1ae8ff9700 1 --2- 172.21.15.50:0/1623306608 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f1ad001f950 0x7f1ad0021e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:11.080 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.069+0000 7f1ae8ff9700 1 -- 172.21.15.50:0/1623306608 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3403+0+0 (secure 0 0 0) 0x7f1ad402a580 con 0x7f1aec122920 2019-12-19T22:08:11.080 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.069+0000 7f1aeb7fe700 1 --2- 172.21.15.50:0/1623306608 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f1ad001f950 0x7f1ad0021e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:11.080 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.069+0000 7f1af182a700 1 --2- 172.21.15.50:0/1623306608 >> [v2:172.21.15.50:6815/27757,v1:172.21.15.50:6817/27757] conn(0x7f1aec063d30 0x7f1aec0550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:11.080 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.069+0000 7f1af182a700 1 -- 172.21.15.50:0/1623306608 --> [v2:172.21.15.50:6815/27757,v1:172.21.15.50:6817/27757] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1aec05dc90 con 0x7f1aec063d30 2019-12-19T22:08:11.080 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.069+0000 7f1aeb7fe700 1 --2- 172.21.15.50:0/1623306608 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f1ad001f950 0x7f1ad0021e60 crc :-1 s=READY pgs=31 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:11.080 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.069+0000 7f1aebfff700 1 --2- 172.21.15.50:0/1623306608 >> [v2:172.21.15.50:6815/27757,v1:172.21.15.50:6817/27757] conn(0x7f1aec063d30 0x7f1aec0550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:11.080 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.069+0000 7f1aebfff700 1 --2- 172.21.15.50:0/1623306608 >> [v2:172.21.15.50:6815/27757,v1:172.21.15.50:6817/27757] conn(0x7f1aec063d30 0x7f1aec0550c0 crc :-1 s=READY pgs=6 cs=0 l=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:11.081 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.070+0000 7f1ae8ff9700 1 -- 172.21.15.50:0/1623306608 <== osd.0 v2:172.21.15.50:6815/27757 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23187 (crc 0 0 0) 0x7f1aec05dc90 con 0x7f1aec063d30 2019-12-19T22:08:11.092 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.088+0000 7f1af182a700 1 -- 172.21.15.50:0/1623306608 --> [v2:172.21.15.50:6815/27757,v1:172.21.15.50:6817/27757] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1aec055610 con 0x7f1aec063d30 2019-12-19T22:08:11.092 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.088+0000 7f1ae8ff9700 1 -- 172.21.15.50:0/1623306608 <== osd.0 v2:172.21.15.50:6815/27757 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1aec055610 con 0x7f1aec063d30 2019-12-19T22:08:11.092 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.089+0000 7f1af182a700 1 -- 172.21.15.50:0/1623306608 >> [v2:172.21.15.50:6815/27757,v1:172.21.15.50:6817/27757] conn(0x7f1aec063d30 msgr2=0x7f1aec0550c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:11.092 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.089+0000 7f1af182a700 1 --2- 172.21.15.50:0/1623306608 >> [v2:172.21.15.50:6815/27757,v1:172.21.15.50:6817/27757] conn(0x7f1aec063d30 0x7f1aec0550c0 crc :-1 s=READY pgs=6 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:11.093 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.089+0000 7f1af182a700 1 -- 172.21.15.50:0/1623306608 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f1ad001f950 msgr2=0x7f1ad0021e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:11.093 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.089+0000 7f1af182a700 1 --2- 172.21.15.50:0/1623306608 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f1ad001f950 0x7f1ad0021e60 crc :-1 s=READY pgs=31 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:11.093 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.089+0000 7f1af182a700 1 -- 172.21.15.50:0/1623306608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aec122920 msgr2=0x7f1aec124d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:11.093 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.089+0000 7f1af182a700 1 --2- 172.21.15.50:0/1623306608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aec122920 0x7f1aec124d60 secure :-1 s=READY pgs=129 cs=0 l=1 rx=0x7f1ad40013e0 tx=0x7f1ad400c2f0).stop 2019-12-19T22:08:11.093 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.089+0000 7f1af182a700 1 -- 172.21.15.50:0/1623306608 shutdown_connections 2019-12-19T22:08:11.093 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.089+0000 7f1af182a700 1 --2- 172.21.15.50:0/1623306608 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f1ad001f950 0x7f1ad0021e60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:11.094 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.089+0000 7f1af182a700 1 --2- 172.21.15.50:0/1623306608 >> [v2:172.21.15.50:6815/27757,v1:172.21.15.50:6817/27757] conn(0x7f1aec063d30 0x7f1aec0550c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:11.094 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.089+0000 7f1af182a700 1 --2- 172.21.15.50:0/1623306608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1aec122920 0x7f1aec124d60 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:11.094 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.089+0000 7f1af182a700 1 -- 172.21.15.50:0/1623306608 shutdown_connections 2019-12-19T22:08:11.094 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.089+0000 7f1af182a700 1 -- 172.21.15.50:0/1623306608 wait complete. 2019-12-19T22:08:11.094 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.089+0000 7f1af182a700 1 -- 172.21.15.50:0/1623306608 >> 172.21.15.50:0/1623306608 conn(0x7f1aec081c40 msgr2=0x7f1aec08bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:11.101 INFO:teuthology.orchestra.run.smithi050.stdout:38654705669 2019-12-19T22:08:11.101 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2019-12-19T22:08:11.221 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.213+0000 7f9e0fda0700 1 Processor -- start 2019-12-19T22:08:11.222 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.213+0000 7f9e0fda0700 1 -- start start 2019-12-19T22:08:11.222 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.213+0000 7f9e0fda0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9e08089480 0x7f9e080898b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:11.222 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.213+0000 7f9e0fda0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e0808edb0 con 0x7f9e0808f3d0 2019-12-19T22:08:11.222 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.213+0000 7f9e0fda0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e0808ae60 con 0x7f9e08089480 2019-12-19T22:08:11.222 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.214+0000 7f9e0e33d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9e08089480 0x7f9e080898b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:11.222 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.214+0000 7f9e0db3c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9e0808f3d0 0x7f9e08081170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39780/0 (socket says 172.21.15.50:39780) 2019-12-19T22:08:11.223 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.214+0000 7f9e0e33d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9e08089480 0x7f9e080898b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53652/0 (socket says 172.21.15.50:53652) 2019-12-19T22:08:11.223 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.214+0000 7f9e0db3c700 1 -- 172.21.15.50:0/3798597004 learned_addr learned my addr 172.21.15.50:0/3798597004 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:11.223 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.214+0000 7f9e0e33d700 1 -- 172.21.15.50:0/3798597004 >> v1:172.21.15.50:6789/0 conn(0x7f9e0808f3d0 legacy=0x7f9e08081170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:11.223 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.214+0000 7f9e0d33b700 1 -- 172.21.15.50:0/3798597004 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3582520668 0 0) 0x7f9e0808edb0 con 0x7f9e0808f3d0 2019-12-19T22:08:11.223 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.214+0000 7f9e0e33d700 1 -- 172.21.15.50:0/3798597004 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e08081970 con 0x7f9e08089480 2019-12-19T22:08:11.223 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.214+0000 7f9e0e33d700 1 --2- 172.21.15.50:0/3798597004 >> v2:172.21.15.50:3300/0 conn(0x7f9e08089480 0x7f9e080898b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9e04008790 tx=0x7f9e0400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.224 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.214+0000 7f9e0e33d700 1 --2- 172.21.15.50:0/3798597004 >> v2:172.21.15.50:3300/0 conn(0x7f9e08089480 0x7f9e080898b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9e04008790 tx=0x7f9e0400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.224 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.214+0000 7f9e0e33d700 1 --2- 172.21.15.50:0/3798597004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e08089480 0x7f9e080898b0 secure :-1 s=READY pgs=131 cs=0 l=1 rx=0x7f9e04008790 tx=0x7f9e0400fbf0).ready entity=mon.0 client_cookie=5ad89e1a9b86e897 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:11.224 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.214+0000 7f9e0e33d700 1 --2- 172.21.15.50:0/3798597004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e08089480 0x7f9e080898b0 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f9e04008790 tx=0x7f9e0400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.224 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.214+0000 7f9e0d33b700 1 -- 172.21.15.50:0/3798597004 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f9e04011270 con 0x7f9e08089480 2019-12-19T22:08:11.224 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.214+0000 7f9e0e33d700 1 --2- 172.21.15.50:0/3798597004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e08089480 0x7f9e080898b0 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f9e04008790 tx=0x7f9e0400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.224 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.214+0000 7f9e0e33d700 1 --2- 172.21.15.50:0/3798597004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e08089480 0x7f9e080898b0 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f9e04008790 tx=0x7f9e0400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.224 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.214+0000 7f9e0d33b700 1 -- 172.21.15.50:0/3798597004 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e04011470 con 0x7f9e08089480 2019-12-19T22:08:11.225 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.214+0000 7f9e0d33b700 1 -- 172.21.15.50:0/3798597004 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f9e04011790 con 0x7f9e08089480 2019-12-19T22:08:11.225 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.214+0000 7f9e0fda0700 1 -- 172.21.15.50:0/3798597004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e08089480 msgr2=0x7f9e080898b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:11.225 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.214+0000 7f9e0fda0700 1 --2- 172.21.15.50:0/3798597004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e08089480 0x7f9e080898b0 secure :-1 s=READY pgs=131 cs=0 l=1 rx=0x7f9e04008790 tx=0x7f9e0400fbf0).stop 2019-12-19T22:08:11.225 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.215+0000 7f9e0fda0700 1 -- 172.21.15.50:0/3798597004 shutdown_connections 2019-12-19T22:08:11.225 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.215+0000 7f9e0fda0700 1 --2- 172.21.15.50:0/3798597004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e08089480 0x7f9e080898b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:11.225 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.215+0000 7f9e0fda0700 1 -- 172.21.15.50:0/3798597004 shutdown_connections 2019-12-19T22:08:11.225 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.215+0000 7f9e0fda0700 1 -- 172.21.15.50:0/3798597004 wait complete. 2019-12-19T22:08:11.226 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.215+0000 7f9e0fda0700 1 -- 172.21.15.50:0/3798597004 >> 172.21.15.50:0/3798597004 conn(0x7f9e08067e70 msgr2=0x7f9e08094570 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:11.226 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.216+0000 7f9e0fda0700 1 Processor -- start 2019-12-19T22:08:11.226 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.216+0000 7f9e0fda0700 1 -- start start 2019-12-19T22:08:11.226 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.216+0000 7f9e0fda0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9e08082520 0x7f9e081216f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:11.226 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.216+0000 7f9e0fda0700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e08082200 con 0x7f9e08121c40 2019-12-19T22:08:11.226 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.216+0000 7f9e0fda0700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e08090fb0 con 0x7f9e08082520 2019-12-19T22:08:11.226 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.216+0000 7f9e0e33d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9e08082520 0x7f9e081216f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:11.227 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.216+0000 7f9e0e33d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9e08082520 0x7f9e081216f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53656/0 (socket says 172.21.15.50:53656) 2019-12-19T22:08:11.227 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.216+0000 7f9e0e33d700 1 -- 172.21.15.50:0/2258434140 learned_addr learned my addr 172.21.15.50:0/2258434140 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:11.227 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.216+0000 7f9e0e33d700 1 -- 172.21.15.50:0/2258434140 >> v1:172.21.15.50:6789/0 conn(0x7f9e08121c40 legacy=0x7f9e080600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:11.227 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.217+0000 7f9e0e33d700 1 -- 172.21.15.50:0/2258434140 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e08061c20 con 0x7f9e08082520 2019-12-19T22:08:11.227 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.217+0000 7f9dfeffd700 1 -- 172.21.15.50:0/2258434140 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 794730865 0 0) 0x7f9e08082200 con 0x7f9e08121c40 2019-12-19T22:08:11.227 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.217+0000 7f9e0e33d700 1 --2- 172.21.15.50:0/2258434140 >> v2:172.21.15.50:3300/0 conn(0x7f9e08082520 0x7f9e081216f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9e04008790 tx=0x7f9e0400f530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.227 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.217+0000 7f9e0e33d700 1 --2- 172.21.15.50:0/2258434140 >> v2:172.21.15.50:3300/0 conn(0x7f9e08082520 0x7f9e081216f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9e04008790 tx=0x7f9e0400f530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.228 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.217+0000 7f9e0e33d700 1 --2- 172.21.15.50:0/2258434140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e08082520 0x7f9e081216f0 secure :-1 s=READY pgs=133 cs=0 l=1 rx=0x7f9e04008790 tx=0x7f9e0400f530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:11.228 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.217+0000 7f9e0e33d700 1 --2- 172.21.15.50:0/2258434140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e08082520 0x7f9e081216f0 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7f9e04008790 tx=0x7f9e0400f530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.228 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.217+0000 7f9dfeffd700 1 -- 172.21.15.50:0/2258434140 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f9e04007280 con 0x7f9e08082520 2019-12-19T22:08:11.228 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.217+0000 7f9e0e33d700 1 --2- 172.21.15.50:0/2258434140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e08082520 0x7f9e081216f0 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7f9e04008790 tx=0x7f9e0400f530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.228 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.217+0000 7f9e0e33d700 1 --2- 172.21.15.50:0/2258434140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e08082520 0x7f9e081216f0 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7f9e04008790 tx=0x7f9e0400f530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.229 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.217+0000 7f9dfeffd700 1 -- 172.21.15.50:0/2258434140 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e04011480 con 0x7f9e08082520 2019-12-19T22:08:11.229 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.217+0000 7f9e0fda0700 1 -- 172.21.15.50:0/2258434140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e08122070 con 0x7f9e08082520 2019-12-19T22:08:11.229 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.217+0000 7f9dfeffd700 1 -- 172.21.15.50:0/2258434140 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f9e040117e0 con 0x7f9e08082520 2019-12-19T22:08:11.229 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.217+0000 7f9e0fda0700 1 -- 172.21.15.50:0/2258434140 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e080608a0 con 0x7f9e08082520 2019-12-19T22:08:11.230 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.217+0000 7f9e0e33d700 1 --2- 172.21.15.50:0/2258434140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e08082520 0x7f9e081216f0 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7f9e04008790 tx=0x7f9e0400f530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.230 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.217+0000 7f9e0e33d700 1 --2- 172.21.15.50:0/2258434140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e08082520 0x7f9e081216f0 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7f9e04008790 tx=0x7f9e0400f530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.230 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.217+0000 7f9dfeffd700 1 -- 172.21.15.50:0/2258434140 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7f9e04005540 con 0x7f9e08082520 2019-12-19T22:08:11.230 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.217+0000 7f9dfeffd700 1 --2- 172.21.15.50:0/2258434140 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f9df001f9f0 0x7f9df0021f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:11.230 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.218+0000 7f9dfeffd700 1 -- 172.21.15.50:0/2258434140 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3403+0+0 (secure 0 0 0) 0x7f9e0402ac70 con 0x7f9e08082520 2019-12-19T22:08:11.230 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.218+0000 7f9e0db3c700 1 --2- 172.21.15.50:0/2258434140 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f9df001f9f0 0x7f9df0021f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:11.230 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.218+0000 7f9e0db3c700 1 --2- 172.21.15.50:0/2258434140 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f9df001f9f0 0x7f9df0021f00 crc :-1 s=READY pgs=32 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:11.231 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.218+0000 7f9e0fda0700 1 --2- 172.21.15.50:0/2258434140 >> [v2:172.21.15.50:6800/27758,v1:172.21.15.50:6801/27758] conn(0x7f9e080550c0 0x7f9e080554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:11.231 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.218+0000 7f9e0fda0700 1 -- 172.21.15.50:0/2258434140 --> [v2:172.21.15.50:6800/27758,v1:172.21.15.50:6801/27758] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9e08056340 con 0x7f9e080550c0 2019-12-19T22:08:11.231 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.218+0000 7f9e0eb3e700 1 --2- 172.21.15.50:0/2258434140 >> [v2:172.21.15.50:6800/27758,v1:172.21.15.50:6801/27758] conn(0x7f9e080550c0 0x7f9e080554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:11.231 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.218+0000 7f9e0eb3e700 1 --2- 172.21.15.50:0/2258434140 >> [v2:172.21.15.50:6800/27758,v1:172.21.15.50:6801/27758] conn(0x7f9e080550c0 0x7f9e080554f0 crc :-1 s=READY pgs=6 cs=0 l=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:11.231 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.219+0000 7f9dfeffd700 1 -- 172.21.15.50:0/2258434140 <== osd.1 v2:172.21.15.50:6800/27758 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23187 (crc 0 0 0) 0x7f9e08056340 con 0x7f9e080550c0 2019-12-19T22:08:11.239 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.237+0000 7f9e0fda0700 1 -- 172.21.15.50:0/2258434140 --> [v2:172.21.15.50:6800/27758,v1:172.21.15.50:6801/27758] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9e08060f50 con 0x7f9e080550c0 2019-12-19T22:08:11.240 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.237+0000 7f9dfeffd700 1 -- 172.21.15.50:0/2258434140 <== osd.1 v2:172.21.15.50:6800/27758 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9e08060f50 con 0x7f9e080550c0 2019-12-19T22:08:11.241 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.238+0000 7f9e0fda0700 1 -- 172.21.15.50:0/2258434140 >> [v2:172.21.15.50:6800/27758,v1:172.21.15.50:6801/27758] conn(0x7f9e080550c0 msgr2=0x7f9e080554f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:11.241 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.238+0000 7f9e0fda0700 1 --2- 172.21.15.50:0/2258434140 >> [v2:172.21.15.50:6800/27758,v1:172.21.15.50:6801/27758] conn(0x7f9e080550c0 0x7f9e080554f0 crc :-1 s=READY pgs=6 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:11.241 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.238+0000 7f9e0fda0700 1 -- 172.21.15.50:0/2258434140 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f9df001f9f0 msgr2=0x7f9df0021f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:11.241 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.238+0000 7f9e0fda0700 1 --2- 172.21.15.50:0/2258434140 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f9df001f9f0 0x7f9df0021f00 crc :-1 s=READY pgs=32 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:11.242 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.238+0000 7f9e0fda0700 1 -- 172.21.15.50:0/2258434140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e08082520 msgr2=0x7f9e081216f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:11.242 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.238+0000 7f9e0fda0700 1 --2- 172.21.15.50:0/2258434140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e08082520 0x7f9e081216f0 secure :-1 s=READY pgs=133 cs=0 l=1 rx=0x7f9e04008790 tx=0x7f9e0400f530).stop 2019-12-19T22:08:11.242 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.238+0000 7f9e0fda0700 1 -- 172.21.15.50:0/2258434140 shutdown_connections 2019-12-19T22:08:11.242 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.238+0000 7f9e0fda0700 1 --2- 172.21.15.50:0/2258434140 >> [v2:172.21.15.50:6800/27758,v1:172.21.15.50:6801/27758] conn(0x7f9e080550c0 0x7f9e080554f0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:11.242 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.238+0000 7f9e0fda0700 1 --2- 172.21.15.50:0/2258434140 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f9df001f9f0 0x7f9df0021f00 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:11.242 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.238+0000 7f9e0fda0700 1 --2- 172.21.15.50:0/2258434140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e08082520 0x7f9e081216f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:11.242 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.238+0000 7f9e0fda0700 1 -- 172.21.15.50:0/2258434140 shutdown_connections 2019-12-19T22:08:11.243 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.238+0000 7f9e0fda0700 1 -- 172.21.15.50:0/2258434140 wait complete. 2019-12-19T22:08:11.243 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.238+0000 7f9e0fda0700 1 -- 172.21.15.50:0/2258434140 >> 172.21.15.50:0/2258434140 conn(0x7f9e08081c40 msgr2=0x7f9e0808cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:11.250 INFO:teuthology.orchestra.run.smithi050.stdout:38654705668 2019-12-19T22:08:11.250 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2019-12-19T22:08:11.369 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.362+0000 7f5238104700 1 Processor -- start 2019-12-19T22:08:11.370 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.362+0000 7f5238104700 1 -- start start 2019-12-19T22:08:11.370 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.362+0000 7f5238104700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5230089480 0x7f52300898b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:11.370 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.362+0000 7f5238104700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f523008edb0 con 0x7f523008f3d0 2019-12-19T22:08:11.370 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.362+0000 7f5238104700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f523008ae60 con 0x7f5230089480 2019-12-19T22:08:11.370 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.362+0000 7f52366a1700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5230089480 0x7f52300898b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:11.370 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.362+0000 7f5235ea0700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f523008f3d0 0x7f5230081170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39792/0 (socket says 172.21.15.50:39792) 2019-12-19T22:08:11.371 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.362+0000 7f5235ea0700 1 -- 172.21.15.50:0/2374636459 learned_addr learned my addr 172.21.15.50:0/2374636459 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:11.371 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.363+0000 7f52366a1700 1 -- 172.21.15.50:0/2374636459 >> v1:172.21.15.50:6789/0 conn(0x7f523008f3d0 legacy=0x7f5230081170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:11.371 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.363+0000 7f523569f700 1 -- 172.21.15.50:0/2374636459 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3154646308 0 0) 0x7f523008edb0 con 0x7f523008f3d0 2019-12-19T22:08:11.371 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.363+0000 7f52366a1700 1 -- 172.21.15.50:0/2374636459 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5230081970 con 0x7f5230089480 2019-12-19T22:08:11.371 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.363+0000 7f52366a1700 1 --2- 172.21.15.50:0/2374636459 >> v2:172.21.15.50:3300/0 conn(0x7f5230089480 0x7f52300898b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5220008790 tx=0x7f522000fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.371 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.363+0000 7f52366a1700 1 --2- 172.21.15.50:0/2374636459 >> v2:172.21.15.50:3300/0 conn(0x7f5230089480 0x7f52300898b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5220008790 tx=0x7f522000fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.371 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.363+0000 7f52366a1700 1 --2- 172.21.15.50:0/2374636459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5230089480 0x7f52300898b0 secure :-1 s=READY pgs=135 cs=0 l=1 rx=0x7f5220008790 tx=0x7f522000fbf0).ready entity=mon.0 client_cookie=c2530e9e2c806b7d server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:11.372 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.363+0000 7f52366a1700 1 --2- 172.21.15.50:0/2374636459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5230089480 0x7f52300898b0 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7f5220008790 tx=0x7f522000fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.372 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.363+0000 7f523569f700 1 -- 172.21.15.50:0/2374636459 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f5220011270 con 0x7f5230089480 2019-12-19T22:08:11.372 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.363+0000 7f52366a1700 1 --2- 172.21.15.50:0/2374636459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5230089480 0x7f52300898b0 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7f5220008790 tx=0x7f522000fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.372 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.363+0000 7f523569f700 1 -- 172.21.15.50:0/2374636459 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5220011470 con 0x7f5230089480 2019-12-19T22:08:11.372 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.363+0000 7f52366a1700 1 --2- 172.21.15.50:0/2374636459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5230089480 0x7f52300898b0 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7f5220008790 tx=0x7f522000fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.372 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.363+0000 7f523569f700 1 -- 172.21.15.50:0/2374636459 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f5220011790 con 0x7f5230089480 2019-12-19T22:08:11.372 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.363+0000 7f5238104700 1 -- 172.21.15.50:0/2374636459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5230089480 msgr2=0x7f52300898b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:11.373 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.363+0000 7f5238104700 1 --2- 172.21.15.50:0/2374636459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5230089480 0x7f52300898b0 secure :-1 s=READY pgs=135 cs=0 l=1 rx=0x7f5220008790 tx=0x7f522000fbf0).stop 2019-12-19T22:08:11.373 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.363+0000 7f5238104700 1 -- 172.21.15.50:0/2374636459 shutdown_connections 2019-12-19T22:08:11.373 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.363+0000 7f5238104700 1 --2- 172.21.15.50:0/2374636459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5230089480 0x7f52300898b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:11.373 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.364+0000 7f5238104700 1 -- 172.21.15.50:0/2374636459 shutdown_connections 2019-12-19T22:08:11.373 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.364+0000 7f5238104700 1 -- 172.21.15.50:0/2374636459 wait complete. 2019-12-19T22:08:11.373 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.364+0000 7f5238104700 1 -- 172.21.15.50:0/2374636459 >> 172.21.15.50:0/2374636459 conn(0x7f5230067e70 msgr2=0x7f5230094570 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:11.373 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.364+0000 7f5238104700 1 Processor -- start 2019-12-19T22:08:11.373 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.365+0000 7f5238104700 1 -- start start 2019-12-19T22:08:11.374 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.365+0000 7f5238104700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5230124940 0x7f5230126d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:11.374 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.365+0000 7f5238104700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5230088f70 con 0x7f52300908d0 2019-12-19T22:08:11.374 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.365+0000 7f5238104700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5230082200 con 0x7f5230124940 2019-12-19T22:08:11.374 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.365+0000 7f52366a1700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f52300908d0 0x7f5230090d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39794/0 (socket says 172.21.15.50:39794) 2019-12-19T22:08:11.374 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.365+0000 7f52366a1700 1 -- 172.21.15.50:0/831310824 learned_addr learned my addr 172.21.15.50:0/831310824 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:11.374 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.365+0000 7f5235ea0700 1 --2- 172.21.15.50:0/831310824 >> v2:172.21.15.50:3300/0 conn(0x7f5230124940 0x7f5230126d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:11.374 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.365+0000 7f5226ffd700 1 -- 172.21.15.50:0/831310824 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 131181339 0 0) 0x7f5230088f70 con 0x7f52300908d0 2019-12-19T22:08:11.375 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.365+0000 7f5226ffd700 1 -- 172.21.15.50:0/831310824 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52180030b0 con 0x7f52300908d0 2019-12-19T22:08:11.375 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.365+0000 7f5235ea0700 1 -- 172.21.15.50:0/831310824 >> v1:172.21.15.50:6789/0 conn(0x7f52300908d0 legacy=0x7f5230090d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:11.375 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.365+0000 7f5235ea0700 1 -- 172.21.15.50:0/831310824 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52300874f0 con 0x7f5230124940 2019-12-19T22:08:11.375 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.365+0000 7f5235ea0700 1 --2- 172.21.15.50:0/831310824 >> v2:172.21.15.50:3300/0 conn(0x7f5230124940 0x7f5230126d80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f522c0043a0 tx=0x7f522c010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.375 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.365+0000 7f5235ea0700 1 --2- 172.21.15.50:0/831310824 >> v2:172.21.15.50:3300/0 conn(0x7f5230124940 0x7f5230126d80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f522c0043a0 tx=0x7f522c010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.375 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.365+0000 7f5235ea0700 1 --2- 172.21.15.50:0/831310824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5230124940 0x7f5230126d80 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7f522c0043a0 tx=0x7f522c010820).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:11.375 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.366+0000 7f5235ea0700 1 --2- 172.21.15.50:0/831310824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5230124940 0x7f5230126d80 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f522c0043a0 tx=0x7f522c010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.376 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.366+0000 7f5226ffd700 1 -- 172.21.15.50:0/831310824 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f522c0114c0 con 0x7f5230124940 2019-12-19T22:08:11.376 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.366+0000 7f5235ea0700 1 --2- 172.21.15.50:0/831310824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5230124940 0x7f5230126d80 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f522c0043a0 tx=0x7f522c010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.376 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.366+0000 7f5235ea0700 1 --2- 172.21.15.50:0/831310824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5230124940 0x7f5230126d80 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f522c0043a0 tx=0x7f522c010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.376 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.366+0000 7f5226ffd700 1 -- 172.21.15.50:0/831310824 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522c0116c0 con 0x7f5230124940 2019-12-19T22:08:11.376 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.366+0000 7f5238104700 1 -- 172.21.15.50:0/831310824 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52300869b0 con 0x7f5230124940 2019-12-19T22:08:11.376 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.366+0000 7f5226ffd700 1 -- 172.21.15.50:0/831310824 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f522c0119e0 con 0x7f5230124940 2019-12-19T22:08:11.377 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.366+0000 7f5238104700 1 -- 172.21.15.50:0/831310824 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5230088c60 con 0x7f5230124940 2019-12-19T22:08:11.377 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.366+0000 7f5235ea0700 1 --2- 172.21.15.50:0/831310824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5230124940 0x7f5230126d80 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f522c0043a0 tx=0x7f522c010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.377 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.366+0000 7f5226ffd700 1 -- 172.21.15.50:0/831310824 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7f522c00b330 con 0x7f5230124940 2019-12-19T22:08:11.377 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.366+0000 7f5235ea0700 1 --2- 172.21.15.50:0/831310824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5230124940 0x7f5230126d80 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7f522c0043a0 tx=0x7f522c010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.377 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.366+0000 7f5226ffd700 1 --2- 172.21.15.50:0/831310824 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f5218020040 0x7f5218022550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:11.377 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.366+0000 7f5226ffd700 1 -- 172.21.15.50:0/831310824 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3403+0+0 (secure 0 0 0) 0x7f522c02a3e0 con 0x7f5230124940 2019-12-19T22:08:11.377 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.366+0000 7f52366a1700 1 --2- 172.21.15.50:0/831310824 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f5218020040 0x7f5218022550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:11.378 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.367+0000 7f5238104700 1 --2- 172.21.15.50:0/831310824 >> [v2:172.21.15.50:6804/27759,v1:172.21.15.50:6806/27759] conn(0x7f52300550c0 0x7f52300554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:11.378 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.367+0000 7f5238104700 1 -- 172.21.15.50:0/831310824 --> [v2:172.21.15.50:6804/27759,v1:172.21.15.50:6806/27759] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5230056340 con 0x7f52300550c0 2019-12-19T22:08:11.378 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.367+0000 7f52366a1700 1 --2- 172.21.15.50:0/831310824 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f5218020040 0x7f5218022550 crc :-1 s=READY pgs=33 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:11.378 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.367+0000 7f5236ea2700 1 --2- 172.21.15.50:0/831310824 >> [v2:172.21.15.50:6804/27759,v1:172.21.15.50:6806/27759] conn(0x7f52300550c0 0x7f52300554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:11.378 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.367+0000 7f5236ea2700 1 --2- 172.21.15.50:0/831310824 >> [v2:172.21.15.50:6804/27759,v1:172.21.15.50:6806/27759] conn(0x7f52300550c0 0x7f52300554f0 crc :-1 s=READY pgs=6 cs=0 l=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:11.379 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.368+0000 7f5226ffd700 1 -- 172.21.15.50:0/831310824 <== osd.2 v2:172.21.15.50:6804/27759 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23187 (crc 0 0 0) 0x7f5230056340 con 0x7f52300550c0 2019-12-19T22:08:11.391 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.386+0000 7f5238104700 1 -- 172.21.15.50:0/831310824 --> [v2:172.21.15.50:6804/27759,v1:172.21.15.50:6806/27759] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5230088020 con 0x7f52300550c0 2019-12-19T22:08:11.391 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.387+0000 7f5226ffd700 1 -- 172.21.15.50:0/831310824 <== osd.2 v2:172.21.15.50:6804/27759 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5230088020 con 0x7f52300550c0 2019-12-19T22:08:11.392 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.387+0000 7f5238104700 1 -- 172.21.15.50:0/831310824 >> [v2:172.21.15.50:6804/27759,v1:172.21.15.50:6806/27759] conn(0x7f52300550c0 msgr2=0x7f52300554f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:11.392 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.387+0000 7f5238104700 1 --2- 172.21.15.50:0/831310824 >> [v2:172.21.15.50:6804/27759,v1:172.21.15.50:6806/27759] conn(0x7f52300550c0 0x7f52300554f0 crc :-1 s=READY pgs=6 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:11.392 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.387+0000 7f5238104700 1 -- 172.21.15.50:0/831310824 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f5218020040 msgr2=0x7f5218022550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:11.392 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.387+0000 7f5238104700 1 --2- 172.21.15.50:0/831310824 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f5218020040 0x7f5218022550 crc :-1 s=READY pgs=33 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:11.392 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.387+0000 7f5238104700 1 -- 172.21.15.50:0/831310824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5230124940 msgr2=0x7f5230126d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:11.392 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.387+0000 7f5238104700 1 --2- 172.21.15.50:0/831310824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5230124940 0x7f5230126d80 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7f522c0043a0 tx=0x7f522c010820).stop 2019-12-19T22:08:11.393 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.387+0000 7f5238104700 1 -- 172.21.15.50:0/831310824 shutdown_connections 2019-12-19T22:08:11.396 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.387+0000 7f5238104700 1 --2- 172.21.15.50:0/831310824 >> [v2:172.21.15.50:6804/27759,v1:172.21.15.50:6806/27759] conn(0x7f52300550c0 0x7f52300554f0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:11.396 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.387+0000 7f5238104700 1 --2- 172.21.15.50:0/831310824 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f5218020040 0x7f5218022550 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:11.396 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.387+0000 7f5238104700 1 --2- 172.21.15.50:0/831310824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5230124940 0x7f5230126d80 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:11.396 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.387+0000 7f5238104700 1 -- 172.21.15.50:0/831310824 shutdown_connections 2019-12-19T22:08:11.396 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.387+0000 7f5238104700 1 -- 172.21.15.50:0/831310824 wait complete. 2019-12-19T22:08:11.396 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.387+0000 7f5238104700 1 -- 172.21.15.50:0/831310824 >> 172.21.15.50:0/831310824 conn(0x7f5230081c40 msgr2=0x7f523008b880 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:11.400 INFO:teuthology.orchestra.run.smithi050.stdout:34359738373 2019-12-19T22:08:11.401 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2019-12-19T22:08:11.521 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.513+0000 7ffba4b20700 1 Processor -- start 2019-12-19T22:08:11.521 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.513+0000 7ffba4b20700 1 -- start start 2019-12-19T22:08:11.521 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.514+0000 7ffba4b20700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffba00898b0 0x7ffba0081170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:11.521 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.514+0000 7ffba4b20700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffba0089ce0 con 0x7ffba0089480 2019-12-19T22:08:11.522 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.514+0000 7ffba4b20700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffba008ae60 con 0x7ffba00898b0 2019-12-19T22:08:11.522 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.514+0000 7ffb9e59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffba00898b0 0x7ffba0081170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:11.522 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.514+0000 7ffb9e59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffba00898b0 0x7ffba0081170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53674/0 (socket says 172.21.15.50:53674) 2019-12-19T22:08:11.522 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.514+0000 7ffb9e59c700 1 -- 172.21.15.50:0/502634866 learned_addr learned my addr 172.21.15.50:0/502634866 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:11.522 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.514+0000 7ffb9e59c700 1 -- 172.21.15.50:0/502634866 >> v1:172.21.15.50:6789/0 conn(0x7ffba0089480 legacy=0x7ffba008f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:11.522 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.514+0000 7ffb9e59c700 1 -- 172.21.15.50:0/502634866 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba008edb0 con 0x7ffba00898b0 2019-12-19T22:08:11.522 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.514+0000 7ffb9e59c700 1 --2- 172.21.15.50:0/502634866 >> v2:172.21.15.50:3300/0 conn(0x7ffba00898b0 0x7ffba0081170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ffb94008790 tx=0x7ffb9400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.523 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.514+0000 7ffb9e59c700 1 --2- 172.21.15.50:0/502634866 >> v2:172.21.15.50:3300/0 conn(0x7ffba00898b0 0x7ffba0081170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ffb94008790 tx=0x7ffb9400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.523 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.514+0000 7ffb9e59c700 1 --2- 172.21.15.50:0/502634866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffba00898b0 0x7ffba0081170 secure :-1 s=READY pgs=139 cs=0 l=1 rx=0x7ffb94008790 tx=0x7ffb9400fcb0).ready entity=mon.0 client_cookie=704eaff73acbfdd7 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:11.523 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.514+0000 7ffb9e59c700 1 --2- 172.21.15.50:0/502634866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffba00898b0 0x7ffba0081170 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7ffb94008790 tx=0x7ffb9400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.523 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.514+0000 7ffb9dd9b700 1 -- 172.21.15.50:0/502634866 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7ffb94011330 con 0x7ffba00898b0 2019-12-19T22:08:11.523 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.514+0000 7ffb9e59c700 1 --2- 172.21.15.50:0/502634866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffba00898b0 0x7ffba0081170 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7ffb94008790 tx=0x7ffb9400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.523 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.514+0000 7ffb9e59c700 1 --2- 172.21.15.50:0/502634866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffba00898b0 0x7ffba0081170 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7ffb94008790 tx=0x7ffb9400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.523 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.514+0000 7ffb9dd9b700 1 -- 172.21.15.50:0/502634866 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb94011530 con 0x7ffba00898b0 2019-12-19T22:08:11.524 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.514+0000 7ffb9dd9b700 1 -- 172.21.15.50:0/502634866 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7ffb94011850 con 0x7ffba00898b0 2019-12-19T22:08:11.524 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.514+0000 7ffba4b20700 1 -- 172.21.15.50:0/502634866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffba00898b0 msgr2=0x7ffba0081170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:11.524 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.514+0000 7ffba4b20700 1 --2- 172.21.15.50:0/502634866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffba00898b0 0x7ffba0081170 secure :-1 s=READY pgs=139 cs=0 l=1 rx=0x7ffb94008790 tx=0x7ffb9400fcb0).stop 2019-12-19T22:08:11.524 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.515+0000 7ffba4b20700 1 -- 172.21.15.50:0/502634866 shutdown_connections 2019-12-19T22:08:11.524 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.515+0000 7ffba4b20700 1 --2- 172.21.15.50:0/502634866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffba00898b0 0x7ffba0081170 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:11.524 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.515+0000 7ffba4b20700 1 -- 172.21.15.50:0/502634866 shutdown_connections 2019-12-19T22:08:11.524 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.515+0000 7ffba4b20700 1 -- 172.21.15.50:0/502634866 wait complete. 2019-12-19T22:08:11.525 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.515+0000 7ffba4b20700 1 -- 172.21.15.50:0/502634866 >> 172.21.15.50:0/502634866 conn(0x7ffba0067e70 msgr2=0x7ffba0094570 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:11.525 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.516+0000 7ffba4b20700 1 Processor -- start 2019-12-19T22:08:11.525 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.516+0000 7ffba4b20700 1 -- start start 2019-12-19T22:08:11.525 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.516+0000 7ffba4b20700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffba01219e0 0x7ffba0123e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:11.525 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.516+0000 7ffba4b20700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffba00845c0 con 0x7ffba00824d0 2019-12-19T22:08:11.525 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.516+0000 7ffba4b20700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffba00892b0 con 0x7ffba01219e0 2019-12-19T22:08:11.525 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.516+0000 7ffb9e59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffba01219e0 0x7ffba0123e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:11.526 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.517+0000 7ffb9e59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ffba01219e0 0x7ffba0123e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53680/0 (socket says 172.21.15.50:53680) 2019-12-19T22:08:11.526 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.517+0000 7ffb9e59c700 1 -- 172.21.15.50:0/1151711630 learned_addr learned my addr 172.21.15.50:0/1151711630 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:11.526 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.517+0000 7ffb9ed9d700 1 --1- 172.21.15.50:0/1151711630 >> v1:172.21.15.50:6789/0 conn(0x7ffba00824d0 0x7ffba0082900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39806/0 (socket says 172.21.15.50:39806) 2019-12-19T22:08:11.526 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.517+0000 7ffb9e59c700 1 -- 172.21.15.50:0/1151711630 >> v1:172.21.15.50:6789/0 conn(0x7ffba00824d0 legacy=0x7ffba0082900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:11.526 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.517+0000 7ffb8f7fe700 1 -- 172.21.15.50:0/1151711630 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3940678290 0 0) 0x7ffba00845c0 con 0x7ffba00824d0 2019-12-19T22:08:11.526 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.517+0000 7ffb9e59c700 1 -- 172.21.15.50:0/1151711630 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba0083db0 con 0x7ffba01219e0 2019-12-19T22:08:11.526 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.517+0000 7ffb9e59c700 1 --2- 172.21.15.50:0/1151711630 >> v2:172.21.15.50:3300/0 conn(0x7ffba01219e0 0x7ffba0123e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffb94008790 tx=0x7ffb9400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.527 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.517+0000 7ffb9e59c700 1 --2- 172.21.15.50:0/1151711630 >> v2:172.21.15.50:3300/0 conn(0x7ffba01219e0 0x7ffba0123e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffb94008790 tx=0x7ffb9400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.527 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.517+0000 7ffb9e59c700 1 --2- 172.21.15.50:0/1151711630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffba01219e0 0x7ffba0123e20 secure :-1 s=READY pgs=141 cs=0 l=1 rx=0x7ffb94008790 tx=0x7ffb9400f780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:11.527 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.517+0000 7ffb9e59c700 1 --2- 172.21.15.50:0/1151711630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffba01219e0 0x7ffba0123e20 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7ffb94008790 tx=0x7ffb9400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.527 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.517+0000 7ffb8f7fe700 1 -- 172.21.15.50:0/1151711630 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7ffb94007280 con 0x7ffba01219e0 2019-12-19T22:08:11.527 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.517+0000 7ffb9e59c700 1 --2- 172.21.15.50:0/1151711630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffba01219e0 0x7ffba0123e20 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7ffb94008790 tx=0x7ffb9400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.527 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.517+0000 7ffb9e59c700 1 --2- 172.21.15.50:0/1151711630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffba01219e0 0x7ffba0123e20 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7ffb94008790 tx=0x7ffb9400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.527 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.517+0000 7ffb8f7fe700 1 -- 172.21.15.50:0/1151711630 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb94011640 con 0x7ffba01219e0 2019-12-19T22:08:11.528 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.517+0000 7ffba4b20700 1 -- 172.21.15.50:0/1151711630 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffba0085d80 con 0x7ffba01219e0 2019-12-19T22:08:11.528 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.517+0000 7ffb8f7fe700 1 -- 172.21.15.50:0/1151711630 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7ffb94005540 con 0x7ffba01219e0 2019-12-19T22:08:11.528 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.517+0000 7ffba4b20700 1 -- 172.21.15.50:0/1151711630 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffba0085440 con 0x7ffba01219e0 2019-12-19T22:08:11.528 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.517+0000 7ffb9e59c700 1 --2- 172.21.15.50:0/1151711630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffba01219e0 0x7ffba0123e20 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7ffb94008790 tx=0x7ffb9400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.538 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.518+0000 7ffb8f7fe700 1 -- 172.21.15.50:0/1151711630 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7ffb940057d0 con 0x7ffba01219e0 2019-12-19T22:08:11.538 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.518+0000 7ffb9e59c700 1 --2- 172.21.15.50:0/1151711630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffba01219e0 0x7ffba0123e20 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7ffb94008790 tx=0x7ffb9400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.538 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.518+0000 7ffb8f7fe700 1 --2- 172.21.15.50:0/1151711630 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7ffb8401f9f0 0x7ffb84021f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:11.538 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.518+0000 7ffb8f7fe700 1 -- 172.21.15.50:0/1151711630 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3403+0+0 (secure 0 0 0) 0x7ffb9402aac0 con 0x7ffba01219e0 2019-12-19T22:08:11.538 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.518+0000 7ffb9ed9d700 1 --2- 172.21.15.50:0/1151711630 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7ffb8401f9f0 0x7ffb84021f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:11.538 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.518+0000 7ffb9ed9d700 1 --2- 172.21.15.50:0/1151711630 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7ffb8401f9f0 0x7ffb84021f00 crc :-1 s=READY pgs=34 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:11.538 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.518+0000 7ffba4b20700 1 -- 172.21.15.50:0/1151711630 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffba0056340 con 0x7ffba01219e0 2019-12-19T22:08:11.539 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.522+0000 7ffb9e59c700 1 --2- 172.21.15.50:0/1151711630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffba01219e0 0x7ffba0123e20 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7ffb94008790 tx=0x7ffb9400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.539 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.522+0000 7ffb8f7fe700 1 -- 172.21.15.50:0/1151711630 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7ffb9402a5a0 con 0x7ffba01219e0 2019-12-19T22:08:11.661 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.658+0000 7ffba4b20700 1 -- 172.21.15.50:0/1151711630 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ffba0086060 con 0x7ffba01219e0 2019-12-19T22:08:11.661 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.658+0000 7ffb9e59c700 1 --2- 172.21.15.50:0/1151711630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffba01219e0 0x7ffba0123e20 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7ffb94008790 tx=0x7ffb9400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:11.661 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.658+0000 7ffb8f7fe700 1 -- 172.21.15.50:0/1151711630 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffb940099b0 con 0x7ffba01219e0 2019-12-19T22:08:11.661 INFO:teuthology.orchestra.run.smithi050.stdout:38654705668 2019-12-19T22:08:11.663 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.659+0000 7ffba4b20700 1 -- 172.21.15.50:0/1151711630 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7ffb8401f9f0 msgr2=0x7ffb84021f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:11.663 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.659+0000 7ffba4b20700 1 --2- 172.21.15.50:0/1151711630 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7ffb8401f9f0 0x7ffb84021f00 crc :-1 s=READY pgs=34 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:11.663 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.659+0000 7ffba4b20700 1 -- 172.21.15.50:0/1151711630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffba01219e0 msgr2=0x7ffba0123e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:11.663 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.659+0000 7ffba4b20700 1 --2- 172.21.15.50:0/1151711630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffba01219e0 0x7ffba0123e20 secure :-1 s=READY pgs=141 cs=0 l=1 rx=0x7ffb94008790 tx=0x7ffb9400f780).stop 2019-12-19T22:08:11.663 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.659+0000 7ffba4b20700 1 -- 172.21.15.50:0/1151711630 shutdown_connections 2019-12-19T22:08:11.664 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.659+0000 7ffba4b20700 1 --2- 172.21.15.50:0/1151711630 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7ffb8401f9f0 0x7ffb84021f00 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:11.664 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.659+0000 7ffba4b20700 1 --2- 172.21.15.50:0/1151711630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffba01219e0 0x7ffba0123e20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:11.664 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.659+0000 7ffba4b20700 1 -- 172.21.15.50:0/1151711630 shutdown_connections 2019-12-19T22:08:11.664 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.659+0000 7ffba4b20700 1 -- 172.21.15.50:0/1151711630 wait complete. 2019-12-19T22:08:11.664 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:11.659+0000 7ffba4b20700 1 -- 172.21.15.50:0/1151711630 >> 172.21.15.50:0/1151711630 conn(0x7ffba0091150 msgr2=0x7ffba007ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:11.672 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.0 2019-12-19T22:08:12.673 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2019-12-19T22:08:12.803 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.798+0000 7fc8caf5c700 1 Processor -- start 2019-12-19T22:08:12.803 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.798+0000 7fc8caf5c700 1 -- start start 2019-12-19T22:08:12.803 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.798+0000 7fc8caf5c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc8c40898b0 0x7fc8c4081170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:12.803 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.798+0000 7fc8caf5c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8c4089ce0 con 0x7fc8c4089480 2019-12-19T22:08:12.804 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.798+0000 7fc8caf5c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8c408ae60 con 0x7fc8c40898b0 2019-12-19T22:08:12.804 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.799+0000 7fc8c8cf8700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc8c40898b0 0x7fc8c4081170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:12.804 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.799+0000 7fc8c8cf8700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc8c40898b0 0x7fc8c4081170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53684/0 (socket says 172.21.15.50:53684) 2019-12-19T22:08:12.804 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.799+0000 7fc8c8cf8700 1 -- 172.21.15.50:0/1675748090 learned_addr learned my addr 172.21.15.50:0/1675748090 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:12.804 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.799+0000 7fc8c8cf8700 1 -- 172.21.15.50:0/1675748090 >> v1:172.21.15.50:6789/0 conn(0x7fc8c4089480 legacy=0x7fc8c408f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:12.804 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.799+0000 7fc8c8cf8700 1 -- 172.21.15.50:0/1675748090 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c408edb0 con 0x7fc8c40898b0 2019-12-19T22:08:12.804 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.799+0000 7fc8c8cf8700 1 --2- 172.21.15.50:0/1675748090 >> v2:172.21.15.50:3300/0 conn(0x7fc8c40898b0 0x7fc8c4081170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc8b4008790 tx=0x7fc8b400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:12.805 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.799+0000 7fc8c8cf8700 1 --2- 172.21.15.50:0/1675748090 >> v2:172.21.15.50:3300/0 conn(0x7fc8c40898b0 0x7fc8c4081170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc8b4008790 tx=0x7fc8b400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:12.805 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.799+0000 7fc8c8cf8700 1 --2- 172.21.15.50:0/1675748090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8c40898b0 0x7fc8c4081170 secure :-1 s=READY pgs=143 cs=0 l=1 rx=0x7fc8b4008790 tx=0x7fc8b400fcb0).ready entity=mon.0 client_cookie=e1e1bd064efe6f91 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:12.805 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.799+0000 7fc8c8cf8700 1 --2- 172.21.15.50:0/1675748090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8c40898b0 0x7fc8c4081170 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7fc8b4008790 tx=0x7fc8b400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:12.805 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.799+0000 7fc8bbfff700 1 -- 172.21.15.50:0/1675748090 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fc8b4011330 con 0x7fc8c40898b0 2019-12-19T22:08:12.805 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.799+0000 7fc8c8cf8700 1 --2- 172.21.15.50:0/1675748090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8c40898b0 0x7fc8c4081170 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7fc8b4008790 tx=0x7fc8b400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:12.805 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.799+0000 7fc8bbfff700 1 -- 172.21.15.50:0/1675748090 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b4011530 con 0x7fc8c40898b0 2019-12-19T22:08:12.805 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.799+0000 7fc8c8cf8700 1 --2- 172.21.15.50:0/1675748090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8c40898b0 0x7fc8c4081170 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7fc8b4008790 tx=0x7fc8b400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:12.806 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.799+0000 7fc8bbfff700 1 -- 172.21.15.50:0/1675748090 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fc8b4011850 con 0x7fc8c40898b0 2019-12-19T22:08:12.806 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.799+0000 7fc8caf5c700 1 -- 172.21.15.50:0/1675748090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8c40898b0 msgr2=0x7fc8c4081170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:12.806 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.799+0000 7fc8caf5c700 1 --2- 172.21.15.50:0/1675748090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8c40898b0 0x7fc8c4081170 secure :-1 s=READY pgs=143 cs=0 l=1 rx=0x7fc8b4008790 tx=0x7fc8b400fcb0).stop 2019-12-19T22:08:12.806 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.800+0000 7fc8caf5c700 1 -- 172.21.15.50:0/1675748090 shutdown_connections 2019-12-19T22:08:12.806 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.800+0000 7fc8caf5c700 1 --2- 172.21.15.50:0/1675748090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8c40898b0 0x7fc8c4081170 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:12.806 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.800+0000 7fc8caf5c700 1 -- 172.21.15.50:0/1675748090 shutdown_connections 2019-12-19T22:08:12.806 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.800+0000 7fc8caf5c700 1 -- 172.21.15.50:0/1675748090 wait complete. 2019-12-19T22:08:12.807 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.800+0000 7fc8caf5c700 1 -- 172.21.15.50:0/1675748090 >> 172.21.15.50:0/1675748090 conn(0x7fc8c4067e70 msgr2=0x7fc8c4094570 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:12.807 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.801+0000 7fc8caf5c700 1 Processor -- start 2019-12-19T22:08:12.807 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.801+0000 7fc8caf5c700 1 -- start start 2019-12-19T22:08:12.810 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.801+0000 7fc8caf5c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc8c4122b50 0x7fc8c4124f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:12.810 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.801+0000 7fc8caf5c700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8c40874b0 con 0x7fc8c411f830 2019-12-19T22:08:12.811 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.801+0000 7fc8caf5c700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8c4090a20 con 0x7fc8c4122b50 2019-12-19T22:08:12.811 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.801+0000 7fc8c8cf8700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc8c4122b50 0x7fc8c4124f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:12.811 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.801+0000 7fc8c94f9700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc8c411f830 0x7fc8c411fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39814/0 (socket says 172.21.15.50:39814) 2019-12-19T22:08:12.811 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.801+0000 7fc8c94f9700 1 -- 172.21.15.50:0/4141485796 learned_addr learned my addr 172.21.15.50:0/4141485796 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:12.811 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.802+0000 7fc8c8cf8700 1 -- 172.21.15.50:0/4141485796 >> v1:172.21.15.50:6789/0 conn(0x7fc8c411f830 legacy=0x7fc8c411fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:12.811 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.802+0000 7fc8c8cf8700 1 -- 172.21.15.50:0/4141485796 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c4085ac0 con 0x7fc8c4122b50 2019-12-19T22:08:12.812 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.802+0000 7fc8b9ffb700 1 -- 172.21.15.50:0/4141485796 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2712634252 0 0) 0x7fc8c40874b0 con 0x7fc8c411f830 2019-12-19T22:08:12.812 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.802+0000 7fc8c8cf8700 1 --2- 172.21.15.50:0/4141485796 >> v2:172.21.15.50:3300/0 conn(0x7fc8c4122b50 0x7fc8c4124f90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc8b4008790 tx=0x7fc8b400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:12.812 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.802+0000 7fc8c8cf8700 1 --2- 172.21.15.50:0/4141485796 >> v2:172.21.15.50:3300/0 conn(0x7fc8c4122b50 0x7fc8c4124f90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc8b4008790 tx=0x7fc8b400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:12.812 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.802+0000 7fc8c8cf8700 1 --2- 172.21.15.50:0/4141485796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8c4122b50 0x7fc8c4124f90 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7fc8b4008790 tx=0x7fc8b400f780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:12.817 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.802+0000 7fc8c8cf8700 1 --2- 172.21.15.50:0/4141485796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8c4122b50 0x7fc8c4124f90 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7fc8b4008790 tx=0x7fc8b400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:12.817 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.802+0000 7fc8b9ffb700 1 -- 172.21.15.50:0/4141485796 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fc8b4007280 con 0x7fc8c4122b50 2019-12-19T22:08:12.817 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.802+0000 7fc8c8cf8700 1 --2- 172.21.15.50:0/4141485796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8c4122b50 0x7fc8c4124f90 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7fc8b4008790 tx=0x7fc8b400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:12.817 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.802+0000 7fc8c8cf8700 1 --2- 172.21.15.50:0/4141485796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8c4122b50 0x7fc8c4124f90 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7fc8b4008790 tx=0x7fc8b400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:12.817 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.802+0000 7fc8b9ffb700 1 -- 172.21.15.50:0/4141485796 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b40115c0 con 0x7fc8c4122b50 2019-12-19T22:08:12.818 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.802+0000 7fc8b9ffb700 1 -- 172.21.15.50:0/4141485796 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fc8b40118e0 con 0x7fc8c4122b50 2019-12-19T22:08:12.818 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.802+0000 7fc8caf5c700 1 -- 172.21.15.50:0/4141485796 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8c4086590 con 0x7fc8c4122b50 2019-12-19T22:08:12.818 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.802+0000 7fc8caf5c700 1 -- 172.21.15.50:0/4141485796 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8c4087100 con 0x7fc8c4122b50 2019-12-19T22:08:12.818 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.802+0000 7fc8c8cf8700 1 --2- 172.21.15.50:0/4141485796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8c4122b50 0x7fc8c4124f90 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7fc8b4008790 tx=0x7fc8b400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:12.818 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.803+0000 7fc8b9ffb700 1 -- 172.21.15.50:0/4141485796 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7fc8b4005540 con 0x7fc8c4122b50 2019-12-19T22:08:12.819 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.803+0000 7fc8c8cf8700 1 --2- 172.21.15.50:0/4141485796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8c4122b50 0x7fc8c4124f90 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7fc8b4008790 tx=0x7fc8b400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:12.819 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.803+0000 7fc8b9ffb700 1 --2- 172.21.15.50:0/4141485796 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fc8a401fa20 0x7fc8a4021f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:12.819 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.803+0000 7fc8b9ffb700 1 -- 172.21.15.50:0/4141485796 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3403+0+0 (secure 0 0 0) 0x7fc8b402a9a0 con 0x7fc8c4122b50 2019-12-19T22:08:12.819 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.803+0000 7fc8c94f9700 1 --2- 172.21.15.50:0/4141485796 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fc8a401fa20 0x7fc8a4021f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:12.819 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.803+0000 7fc8caf5c700 1 -- 172.21.15.50:0/4141485796 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8c4056340 con 0x7fc8c4122b50 2019-12-19T22:08:12.819 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.803+0000 7fc8c94f9700 1 --2- 172.21.15.50:0/4141485796 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fc8a401fa20 0x7fc8a4021f30 crc :-1 s=READY pgs=35 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:12.819 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.807+0000 7fc8c8cf8700 1 --2- 172.21.15.50:0/4141485796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8c4122b50 0x7fc8c4124f90 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7fc8b4008790 tx=0x7fc8b400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:12.820 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.807+0000 7fc8b9ffb700 1 -- 172.21.15.50:0/4141485796 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7fc8b4005dc0 con 0x7fc8c4122b50 2019-12-19T22:08:12.947 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.944+0000 7fc8caf5c700 1 -- 172.21.15.50:0/4141485796 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc8c4082200 con 0x7fc8c4122b50 2019-12-19T22:08:12.947 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.945+0000 7fc8c8cf8700 1 --2- 172.21.15.50:0/4141485796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8c4122b50 0x7fc8c4124f90 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7fc8b4008790 tx=0x7fc8b400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:12.947 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.945+0000 7fc8b9ffb700 1 -- 172.21.15.50:0/4141485796 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc8b40058a0 con 0x7fc8c4122b50 2019-12-19T22:08:12.947 INFO:teuthology.orchestra.run.smithi050.stdout:38654705669 2019-12-19T22:08:12.948 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.946+0000 7fc8caf5c700 1 -- 172.21.15.50:0/4141485796 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fc8a401fa20 msgr2=0x7fc8a4021f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:12.949 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.946+0000 7fc8caf5c700 1 --2- 172.21.15.50:0/4141485796 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fc8a401fa20 0x7fc8a4021f30 crc :-1 s=READY pgs=35 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:12.949 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.946+0000 7fc8caf5c700 1 -- 172.21.15.50:0/4141485796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8c4122b50 msgr2=0x7fc8c4124f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:12.949 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.946+0000 7fc8caf5c700 1 --2- 172.21.15.50:0/4141485796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8c4122b50 0x7fc8c4124f90 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7fc8b4008790 tx=0x7fc8b400f780).stop 2019-12-19T22:08:12.949 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.946+0000 7fc8caf5c700 1 -- 172.21.15.50:0/4141485796 shutdown_connections 2019-12-19T22:08:12.949 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.946+0000 7fc8caf5c700 1 --2- 172.21.15.50:0/4141485796 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fc8a401fa20 0x7fc8a4021f30 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:12.949 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.946+0000 7fc8caf5c700 1 --2- 172.21.15.50:0/4141485796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8c4122b50 0x7fc8c4124f90 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:12.950 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.946+0000 7fc8caf5c700 1 -- 172.21.15.50:0/4141485796 shutdown_connections 2019-12-19T22:08:12.950 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.946+0000 7fc8caf5c700 1 -- 172.21.15.50:0/4141485796 wait complete. 2019-12-19T22:08:12.950 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:12.946+0000 7fc8caf5c700 1 -- 172.21.15.50:0/4141485796 >> 172.21.15.50:0/4141485796 conn(0x7fc8c4091150 msgr2=0x7fc8c407ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:12.958 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.0 2019-12-19T22:08:12.959 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2019-12-19T22:08:13.083 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.072+0000 7f91090ec700 1 Processor -- start 2019-12-19T22:08:13.083 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.072+0000 7f91090ec700 1 -- start start 2019-12-19T22:08:13.083 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.072+0000 7f91090ec700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f91040898b0 0x7f9104081170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:13.083 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.072+0000 7f91090ec700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9104089ce0 con 0x7f9104089480 2019-12-19T22:08:13.083 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.072+0000 7f91090ec700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f910408ae60 con 0x7f91040898b0 2019-12-19T22:08:13.084 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.072+0000 7f9102d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f91040898b0 0x7f9104081170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:13.084 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.072+0000 7f9102d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f91040898b0 0x7f9104081170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53692/0 (socket says 172.21.15.50:53692) 2019-12-19T22:08:13.084 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.072+0000 7f9102d9d700 1 -- 172.21.15.50:0/3893717897 learned_addr learned my addr 172.21.15.50:0/3893717897 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:13.084 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.072+0000 7f910359e700 1 --1- 172.21.15.50:0/3893717897 >> v1:172.21.15.50:6789/0 conn(0x7f9104089480 0x7f910408f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39820/0 (socket says 172.21.15.50:39820) 2019-12-19T22:08:13.085 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.072+0000 7f9102d9d700 1 -- 172.21.15.50:0/3893717897 >> v1:172.21.15.50:6789/0 conn(0x7f9104089480 legacy=0x7f910408f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:13.085 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.072+0000 7f9102d9d700 1 -- 172.21.15.50:0/3893717897 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f910408edb0 con 0x7f91040898b0 2019-12-19T22:08:13.085 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.072+0000 7f9102d9d700 1 --2- 172.21.15.50:0/3893717897 >> v2:172.21.15.50:3300/0 conn(0x7f91040898b0 0x7f9104081170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f90f8008790 tx=0x7f90f800fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.085 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.073+0000 7f9102d9d700 1 --2- 172.21.15.50:0/3893717897 >> v2:172.21.15.50:3300/0 conn(0x7f91040898b0 0x7f9104081170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f90f8008790 tx=0x7f90f800fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.085 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.073+0000 7f9102d9d700 1 --2- 172.21.15.50:0/3893717897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91040898b0 0x7f9104081170 secure :-1 s=READY pgs=147 cs=0 l=1 rx=0x7f90f8008790 tx=0x7f90f800fcb0).ready entity=mon.0 client_cookie=3cfcbcab759b0dee server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:13.085 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.073+0000 7f9102d9d700 1 --2- 172.21.15.50:0/3893717897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91040898b0 0x7f9104081170 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f90f8008790 tx=0x7f90f800fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.086 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.073+0000 7f910259c700 1 -- 172.21.15.50:0/3893717897 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f90f8011330 con 0x7f91040898b0 2019-12-19T22:08:13.086 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.073+0000 7f9102d9d700 1 --2- 172.21.15.50:0/3893717897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91040898b0 0x7f9104081170 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f90f8008790 tx=0x7f90f800fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.086 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.073+0000 7f9102d9d700 1 --2- 172.21.15.50:0/3893717897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91040898b0 0x7f9104081170 secure :-1 s=THROTTLE_DONE pgs=147 cs=0 l=1 rx=0x7f90f8008790 tx=0x7f90f800fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.086 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.073+0000 7f910259c700 1 -- 172.21.15.50:0/3893717897 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f8011530 con 0x7f91040898b0 2019-12-19T22:08:13.086 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.073+0000 7f910259c700 1 -- 172.21.15.50:0/3893717897 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f90f8011850 con 0x7f91040898b0 2019-12-19T22:08:13.086 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.073+0000 7f91090ec700 1 -- 172.21.15.50:0/3893717897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91040898b0 msgr2=0x7f9104081170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:13.086 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.073+0000 7f91090ec700 1 --2- 172.21.15.50:0/3893717897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91040898b0 0x7f9104081170 secure :-1 s=READY pgs=147 cs=0 l=1 rx=0x7f90f8008790 tx=0x7f90f800fcb0).stop 2019-12-19T22:08:13.087 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.073+0000 7f91090ec700 1 -- 172.21.15.50:0/3893717897 shutdown_connections 2019-12-19T22:08:13.087 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.073+0000 7f91090ec700 1 --2- 172.21.15.50:0/3893717897 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91040898b0 0x7f9104081170 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:13.087 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.073+0000 7f91090ec700 1 -- 172.21.15.50:0/3893717897 shutdown_connections 2019-12-19T22:08:13.087 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.073+0000 7f91090ec700 1 -- 172.21.15.50:0/3893717897 wait complete. 2019-12-19T22:08:13.087 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.073+0000 7f91090ec700 1 -- 172.21.15.50:0/3893717897 >> 172.21.15.50:0/3893717897 conn(0x7f9104067e70 msgr2=0x7f9104094570 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:13.087 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.074+0000 7f91090ec700 1 Processor -- start 2019-12-19T22:08:13.087 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.074+0000 7f91090ec700 1 -- start start 2019-12-19T22:08:13.088 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.075+0000 7f91090ec700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9104124b50 0x7f9104126f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:13.088 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.075+0000 7f91090ec700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f910405f790 con 0x7f9104090040 2019-12-19T22:08:13.088 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.075+0000 7f91090ec700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91040841a0 con 0x7f9104124b50 2019-12-19T22:08:13.088 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.075+0000 7f9102d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f9104124b50 0x7f9104126f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:13.088 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.075+0000 7f910359e700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f9104090040 0x7f9104090470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39822/0 (socket says 172.21.15.50:39822) 2019-12-19T22:08:13.088 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.075+0000 7f910359e700 1 -- 172.21.15.50:0/1643195157 learned_addr learned my addr 172.21.15.50:0/1643195157 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:13.088 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.075+0000 7f9102d9d700 1 -- 172.21.15.50:0/1643195157 >> v1:172.21.15.50:6789/0 conn(0x7f9104090040 legacy=0x7f9104090470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:13.089 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.075+0000 7f90ebfff700 1 -- 172.21.15.50:0/1643195157 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 684776872 0 0) 0x7f910405f790 con 0x7f9104090040 2019-12-19T22:08:13.089 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.075+0000 7f9102d9d700 1 -- 172.21.15.50:0/1643195157 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9104082200 con 0x7f9104124b50 2019-12-19T22:08:13.089 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.075+0000 7f9102d9d700 1 --2- 172.21.15.50:0/1643195157 >> v2:172.21.15.50:3300/0 conn(0x7f9104124b50 0x7f9104126f90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f90f8008790 tx=0x7f90f800f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.089 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.075+0000 7f9102d9d700 1 --2- 172.21.15.50:0/1643195157 >> v2:172.21.15.50:3300/0 conn(0x7f9104124b50 0x7f9104126f90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f90f8008790 tx=0x7f90f800f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.089 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.075+0000 7f9102d9d700 1 --2- 172.21.15.50:0/1643195157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9104124b50 0x7f9104126f90 secure :-1 s=READY pgs=149 cs=0 l=1 rx=0x7f90f8008790 tx=0x7f90f800f780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:13.089 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.075+0000 7f9102d9d700 1 --2- 172.21.15.50:0/1643195157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9104124b50 0x7f9104126f90 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f90f8008790 tx=0x7f90f800f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.089 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.075+0000 7f90ebfff700 1 -- 172.21.15.50:0/1643195157 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f90f8007280 con 0x7f9104124b50 2019-12-19T22:08:13.090 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.075+0000 7f9102d9d700 1 --2- 172.21.15.50:0/1643195157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9104124b50 0x7f9104126f90 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f90f8008790 tx=0x7f90f800f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.090 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.075+0000 7f9102d9d700 1 --2- 172.21.15.50:0/1643195157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9104124b50 0x7f9104126f90 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f90f8008790 tx=0x7f90f800f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.090 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.075+0000 7f90ebfff700 1 -- 172.21.15.50:0/1643195157 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f80115c0 con 0x7f9104124b50 2019-12-19T22:08:13.090 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.075+0000 7f91090ec700 1 -- 172.21.15.50:0/1643195157 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f910407b080 con 0x7f9104124b50 2019-12-19T22:08:13.090 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.075+0000 7f90ebfff700 1 -- 172.21.15.50:0/1643195157 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f90f80118e0 con 0x7f9104124b50 2019-12-19T22:08:13.090 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.075+0000 7f91090ec700 1 -- 172.21.15.50:0/1643195157 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9104083d90 con 0x7f9104124b50 2019-12-19T22:08:13.090 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.076+0000 7f9102d9d700 1 --2- 172.21.15.50:0/1643195157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9104124b50 0x7f9104126f90 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f90f8008790 tx=0x7f90f800f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.091 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.076+0000 7f90ebfff700 1 -- 172.21.15.50:0/1643195157 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7f90f8005540 con 0x7f9104124b50 2019-12-19T22:08:13.091 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.076+0000 7f9102d9d700 1 --2- 172.21.15.50:0/1643195157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9104124b50 0x7f9104126f90 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f90f8008790 tx=0x7f90f800f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.091 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.076+0000 7f90ebfff700 1 --2- 172.21.15.50:0/1643195157 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f90e401f9f0 0x7f90e4021f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:13.091 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.076+0000 7f90ebfff700 1 -- 172.21.15.50:0/1643195157 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3403+0+0 (secure 0 0 0) 0x7f90f802a9a0 con 0x7f9104124b50 2019-12-19T22:08:13.091 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.076+0000 7f910359e700 1 --2- 172.21.15.50:0/1643195157 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f90e401f9f0 0x7f90e4021f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:13.091 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.076+0000 7f91090ec700 1 -- 172.21.15.50:0/1643195157 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9104056340 con 0x7f9104124b50 2019-12-19T22:08:13.091 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.076+0000 7f910359e700 1 --2- 172.21.15.50:0/1643195157 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f90e401f9f0 0x7f90e4021f00 crc :-1 s=READY pgs=36 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:13.092 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.080+0000 7f9102d9d700 1 --2- 172.21.15.50:0/1643195157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9104124b50 0x7f9104126f90 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f90f8008790 tx=0x7f90f800f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.092 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.080+0000 7f90ebfff700 1 -- 172.21.15.50:0/1643195157 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7f90f8005dc0 con 0x7f9104124b50 2019-12-19T22:08:13.224 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.222+0000 7f91090ec700 1 -- 172.21.15.50:0/1643195157 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f910408dcf0 con 0x7f9104124b50 2019-12-19T22:08:13.225 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.222+0000 7f9102d9d700 1 --2- 172.21.15.50:0/1643195157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9104124b50 0x7f9104126f90 secure :-1 s=THROTTLE_DONE pgs=149 cs=0 l=1 rx=0x7f90f8008790 tx=0x7f90f800f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.225 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.222+0000 7f90ebfff700 1 -- 172.21.15.50:0/1643195157 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f90f80058a0 con 0x7f9104124b50 2019-12-19T22:08:13.225 INFO:teuthology.orchestra.run.smithi050.stdout:38654705668 2019-12-19T22:08:13.226 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.223+0000 7f91090ec700 1 -- 172.21.15.50:0/1643195157 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f90e401f9f0 msgr2=0x7f90e4021f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:13.226 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.223+0000 7f91090ec700 1 --2- 172.21.15.50:0/1643195157 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f90e401f9f0 0x7f90e4021f00 crc :-1 s=READY pgs=36 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:13.226 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.223+0000 7f91090ec700 1 -- 172.21.15.50:0/1643195157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9104124b50 msgr2=0x7f9104126f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:13.226 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.223+0000 7f91090ec700 1 --2- 172.21.15.50:0/1643195157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9104124b50 0x7f9104126f90 secure :-1 s=READY pgs=149 cs=0 l=1 rx=0x7f90f8008790 tx=0x7f90f800f780).stop 2019-12-19T22:08:13.227 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.223+0000 7f91090ec700 1 -- 172.21.15.50:0/1643195157 shutdown_connections 2019-12-19T22:08:13.227 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.223+0000 7f91090ec700 1 --2- 172.21.15.50:0/1643195157 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f90e401f9f0 0x7f90e4021f00 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:13.227 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.223+0000 7f91090ec700 1 --2- 172.21.15.50:0/1643195157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9104124b50 0x7f9104126f90 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:13.227 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.223+0000 7f91090ec700 1 -- 172.21.15.50:0/1643195157 shutdown_connections 2019-12-19T22:08:13.227 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.223+0000 7f91090ec700 1 -- 172.21.15.50:0/1643195157 wait complete. 2019-12-19T22:08:13.229 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.223+0000 7f91090ec700 1 -- 172.21.15.50:0/1643195157 >> 172.21.15.50:0/1643195157 conn(0x7f9104091150 msgr2=0x7f910407ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:13.236 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705668 for osd.1 2019-12-19T22:08:13.236 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2019-12-19T22:08:13.353 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.348+0000 7f28e27da700 1 Processor -- start 2019-12-19T22:08:13.353 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.348+0000 7f28e27da700 1 -- start start 2019-12-19T22:08:13.354 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.349+0000 7f28e27da700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f28dc089480 0x7f28dc0898b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:13.354 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.349+0000 7f28e27da700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28dc08edb0 con 0x7f28dc08f3d0 2019-12-19T22:08:13.354 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.349+0000 7f28e27da700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28dc08ae60 con 0x7f28dc089480 2019-12-19T22:08:13.354 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.349+0000 7f28e0d77700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f28dc089480 0x7f28dc0898b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:13.354 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.349+0000 7f28e0d77700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f28dc089480 0x7f28dc0898b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53700/0 (socket says 172.21.15.50:53700) 2019-12-19T22:08:13.354 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.349+0000 7f28e0d77700 1 -- 172.21.15.50:0/3643849755 learned_addr learned my addr 172.21.15.50:0/3643849755 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:13.354 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.349+0000 7f28dbfff700 1 --1- 172.21.15.50:0/3643849755 >> v1:172.21.15.50:6789/0 conn(0x7f28dc08f3d0 0x7f28dc081170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39828/0 (socket says 172.21.15.50:39828) 2019-12-19T22:08:13.355 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.349+0000 7f28e0d77700 1 -- 172.21.15.50:0/3643849755 >> v1:172.21.15.50:6789/0 conn(0x7f28dc08f3d0 legacy=0x7f28dc081170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:13.355 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.349+0000 7f28e0d77700 1 -- 172.21.15.50:0/3643849755 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28dc081970 con 0x7f28dc089480 2019-12-19T22:08:13.355 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.349+0000 7f28e0d77700 1 --2- 172.21.15.50:0/3643849755 >> v2:172.21.15.50:3300/0 conn(0x7f28dc089480 0x7f28dc0898b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f28cc008790 tx=0x7f28cc00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.355 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.349+0000 7f28e0d77700 1 --2- 172.21.15.50:0/3643849755 >> v2:172.21.15.50:3300/0 conn(0x7f28dc089480 0x7f28dc0898b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f28cc008790 tx=0x7f28cc00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.355 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.349+0000 7f28e0d77700 1 --2- 172.21.15.50:0/3643849755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28dc089480 0x7f28dc0898b0 secure :-1 s=READY pgs=151 cs=0 l=1 rx=0x7f28cc008790 tx=0x7f28cc00fcb0).ready entity=mon.0 client_cookie=71c2973f75a6f3ca server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:13.355 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.349+0000 7f28e0d77700 1 --2- 172.21.15.50:0/3643849755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28dc089480 0x7f28dc0898b0 secure :-1 s=THROTTLE_DONE pgs=151 cs=0 l=1 rx=0x7f28cc008790 tx=0x7f28cc00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.355 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.349+0000 7f28db7fe700 1 -- 172.21.15.50:0/3643849755 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f28cc011330 con 0x7f28dc089480 2019-12-19T22:08:13.356 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.349+0000 7f28e0d77700 1 --2- 172.21.15.50:0/3643849755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28dc089480 0x7f28dc0898b0 secure :-1 s=THROTTLE_DONE pgs=151 cs=0 l=1 rx=0x7f28cc008790 tx=0x7f28cc00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.356 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.349+0000 7f28e0d77700 1 --2- 172.21.15.50:0/3643849755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28dc089480 0x7f28dc0898b0 secure :-1 s=THROTTLE_DONE pgs=151 cs=0 l=1 rx=0x7f28cc008790 tx=0x7f28cc00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.356 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.349+0000 7f28db7fe700 1 -- 172.21.15.50:0/3643849755 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28cc011530 con 0x7f28dc089480 2019-12-19T22:08:13.356 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.349+0000 7f28db7fe700 1 -- 172.21.15.50:0/3643849755 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f28cc011850 con 0x7f28dc089480 2019-12-19T22:08:13.356 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.349+0000 7f28e27da700 1 -- 172.21.15.50:0/3643849755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28dc089480 msgr2=0x7f28dc0898b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:13.356 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.349+0000 7f28e27da700 1 --2- 172.21.15.50:0/3643849755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28dc089480 0x7f28dc0898b0 secure :-1 s=READY pgs=151 cs=0 l=1 rx=0x7f28cc008790 tx=0x7f28cc00fcb0).stop 2019-12-19T22:08:13.357 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.350+0000 7f28e27da700 1 -- 172.21.15.50:0/3643849755 shutdown_connections 2019-12-19T22:08:13.357 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.350+0000 7f28e27da700 1 --2- 172.21.15.50:0/3643849755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28dc089480 0x7f28dc0898b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:13.357 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.350+0000 7f28e27da700 1 -- 172.21.15.50:0/3643849755 shutdown_connections 2019-12-19T22:08:13.357 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.350+0000 7f28e27da700 1 -- 172.21.15.50:0/3643849755 wait complete. 2019-12-19T22:08:13.357 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.350+0000 7f28e27da700 1 -- 172.21.15.50:0/3643849755 >> 172.21.15.50:0/3643849755 conn(0x7f28dc067e70 msgr2=0x7f28dc094570 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:13.357 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.351+0000 7f28e27da700 1 Processor -- start 2019-12-19T22:08:13.357 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.351+0000 7f28e27da700 1 -- start start 2019-12-19T22:08:13.360 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.351+0000 7f28e27da700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f28dc082a00 0x7f28dc123920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:13.360 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.352+0000 7f28e27da700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28dc0891b0 con 0x7f28dc085c80 2019-12-19T22:08:13.360 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.352+0000 7f28e27da700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28dc083cd0 con 0x7f28dc082a00 2019-12-19T22:08:13.361 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.352+0000 7f28dbfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f28dc082a00 0x7f28dc123920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:13.361 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.352+0000 7f28e0d77700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f28dc085c80 0x7f28dc082200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39832/0 (socket says 172.21.15.50:39832) 2019-12-19T22:08:13.361 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.352+0000 7f28e0d77700 1 -- 172.21.15.50:0/1815502745 learned_addr learned my addr 172.21.15.50:0/1815502745 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:13.361 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.352+0000 7f28dbfff700 1 -- 172.21.15.50:0/1815502745 >> v1:172.21.15.50:6789/0 conn(0x7f28dc085c80 legacy=0x7f28dc082200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:13.361 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.352+0000 7f28dbfff700 1 -- 172.21.15.50:0/1815502745 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28dc084bc0 con 0x7f28dc082a00 2019-12-19T22:08:13.361 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.352+0000 7f28d97fa700 1 -- 172.21.15.50:0/1815502745 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 246702205 0 0) 0x7f28dc0891b0 con 0x7f28dc085c80 2019-12-19T22:08:13.362 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.352+0000 7f28dbfff700 1 --2- 172.21.15.50:0/1815502745 >> v2:172.21.15.50:3300/0 conn(0x7f28dc082a00 0x7f28dc123920 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f28dc084010 tx=0x7f28d000c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.362 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.352+0000 7f28dbfff700 1 --2- 172.21.15.50:0/1815502745 >> v2:172.21.15.50:3300/0 conn(0x7f28dc082a00 0x7f28dc123920 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f28dc084010 tx=0x7f28d000c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.362 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.352+0000 7f28dbfff700 1 --2- 172.21.15.50:0/1815502745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28dc082a00 0x7f28dc123920 secure :-1 s=READY pgs=153 cs=0 l=1 rx=0x7f28dc084010 tx=0x7f28d000c340).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:13.362 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.352+0000 7f28dbfff700 1 --2- 172.21.15.50:0/1815502745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28dc082a00 0x7f28dc123920 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7f28dc084010 tx=0x7f28d000c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.362 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.352+0000 7f28d97fa700 1 -- 172.21.15.50:0/1815502745 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f28d00114e0 con 0x7f28dc082a00 2019-12-19T22:08:13.362 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.352+0000 7f28dbfff700 1 --2- 172.21.15.50:0/1815502745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28dc082a00 0x7f28dc123920 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7f28dc084010 tx=0x7f28d000c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.362 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.352+0000 7f28dbfff700 1 --2- 172.21.15.50:0/1815502745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28dc082a00 0x7f28dc123920 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7f28dc084010 tx=0x7f28d000c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.363 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.352+0000 7f28d97fa700 1 -- 172.21.15.50:0/1815502745 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d00116e0 con 0x7f28dc082a00 2019-12-19T22:08:13.363 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.352+0000 7f28e27da700 1 -- 172.21.15.50:0/1815502745 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28dc0835c0 con 0x7f28dc082a00 2019-12-19T22:08:13.363 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.352+0000 7f28d97fa700 1 -- 172.21.15.50:0/1815502745 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f28d0011ac0 con 0x7f28dc082a00 2019-12-19T22:08:13.363 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.352+0000 7f28e27da700 1 -- 172.21.15.50:0/1815502745 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28dc085340 con 0x7f28dc082a00 2019-12-19T22:08:13.363 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.353+0000 7f28dbfff700 1 --2- 172.21.15.50:0/1815502745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28dc082a00 0x7f28dc123920 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7f28dc084010 tx=0x7f28d000c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.363 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.353+0000 7f28d97fa700 1 -- 172.21.15.50:0/1815502745 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7f28d0006460 con 0x7f28dc082a00 2019-12-19T22:08:13.363 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.353+0000 7f28dbfff700 1 --2- 172.21.15.50:0/1815502745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28dc082a00 0x7f28dc123920 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7f28dc084010 tx=0x7f28d000c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.364 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.353+0000 7f28d97fa700 1 --2- 172.21.15.50:0/1815502745 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f28bc01f990 0x7f28bc021ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:13.364 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.353+0000 7f28d97fa700 1 -- 172.21.15.50:0/1815502745 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3403+0+0 (secure 0 0 0) 0x7f28d002a180 con 0x7f28dc082a00 2019-12-19T22:08:13.364 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.353+0000 7f28e0d77700 1 --2- 172.21.15.50:0/1815502745 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f28bc01f990 0x7f28bc021ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:13.364 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.353+0000 7f28e0d77700 1 --2- 172.21.15.50:0/1815502745 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f28bc01f990 0x7f28bc021ea0 crc :-1 s=READY pgs=37 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:13.366 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.353+0000 7f28e27da700 1 -- 172.21.15.50:0/1815502745 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28dc056340 con 0x7f28dc082a00 2019-12-19T22:08:13.366 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.357+0000 7f28dbfff700 1 --2- 172.21.15.50:0/1815502745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28dc082a00 0x7f28dc123920 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7f28dc084010 tx=0x7f28d000c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.367 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.357+0000 7f28d97fa700 1 -- 172.21.15.50:0/1815502745 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7f28d000c3c0 con 0x7f28dc082a00 2019-12-19T22:08:13.498 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.495+0000 7f28e27da700 1 -- 172.21.15.50:0/1815502745 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f28dc08dcf0 con 0x7f28dc082a00 2019-12-19T22:08:13.498 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.495+0000 7f28dbfff700 1 --2- 172.21.15.50:0/1815502745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28dc082a00 0x7f28dc123920 secure :-1 s=THROTTLE_DONE pgs=153 cs=0 l=1 rx=0x7f28dc084010 tx=0x7f28d000c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.498 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.495+0000 7f28d97fa700 1 -- 172.21.15.50:0/1815502745 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f28d00101b0 con 0x7f28dc082a00 2019-12-19T22:08:13.498 INFO:teuthology.orchestra.run.smithi050.stdout:34359738373 2019-12-19T22:08:13.499 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.496+0000 7f28e27da700 1 -- 172.21.15.50:0/1815502745 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f28bc01f990 msgr2=0x7f28bc021ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:13.500 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.496+0000 7f28e27da700 1 --2- 172.21.15.50:0/1815502745 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f28bc01f990 0x7f28bc021ea0 crc :-1 s=READY pgs=37 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:13.500 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.496+0000 7f28e27da700 1 -- 172.21.15.50:0/1815502745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28dc082a00 msgr2=0x7f28dc123920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:13.500 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.496+0000 7f28e27da700 1 --2- 172.21.15.50:0/1815502745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28dc082a00 0x7f28dc123920 secure :-1 s=READY pgs=153 cs=0 l=1 rx=0x7f28dc084010 tx=0x7f28d000c340).stop 2019-12-19T22:08:13.500 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.496+0000 7f28e27da700 1 -- 172.21.15.50:0/1815502745 shutdown_connections 2019-12-19T22:08:13.500 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.496+0000 7f28e27da700 1 --2- 172.21.15.50:0/1815502745 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f28bc01f990 0x7f28bc021ea0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:13.500 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.496+0000 7f28e27da700 1 --2- 172.21.15.50:0/1815502745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28dc082a00 0x7f28dc123920 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:13.500 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.496+0000 7f28e27da700 1 -- 172.21.15.50:0/1815502745 shutdown_connections 2019-12-19T22:08:13.501 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.496+0000 7f28e27da700 1 -- 172.21.15.50:0/1815502745 wait complete. 2019-12-19T22:08:13.501 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.496+0000 7f28e27da700 1 -- 172.21.15.50:0/1815502745 >> 172.21.15.50:0/1815502745 conn(0x7f28dc081c40 msgr2=0x7f28dc07f640 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:13.514 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738373 for osd.2 2019-12-19T22:08:13.514 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2019-12-19T22:08:13.514 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2019-12-19T22:08:13.633 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.628+0000 7fded45de700 1 Processor -- start 2019-12-19T22:08:13.634 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.628+0000 7fded45de700 1 -- start start 2019-12-19T22:08:13.634 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.629+0000 7fded45de700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdecc0898b0 0x7fdecc081170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:13.634 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.629+0000 7fded45de700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdecc089ce0 con 0x7fdecc089480 2019-12-19T22:08:13.634 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.629+0000 7fded45de700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdecc08ae60 con 0x7fdecc0898b0 2019-12-19T22:08:13.634 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.629+0000 7fded237a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdecc0898b0 0x7fdecc081170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:13.634 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.629+0000 7fded2b7b700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fdecc089480 0x7fdecc08f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39838/0 (socket says 172.21.15.50:39838) 2019-12-19T22:08:13.635 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.629+0000 7fded2b7b700 1 -- 172.21.15.50:0/1467631868 learned_addr learned my addr 172.21.15.50:0/1467631868 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:13.635 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.629+0000 7fded237a700 1 -- 172.21.15.50:0/1467631868 >> v1:172.21.15.50:6789/0 conn(0x7fdecc089480 legacy=0x7fdecc08f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:13.635 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.629+0000 7fded1b79700 1 -- 172.21.15.50:0/1467631868 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3006682102 0 0) 0x7fdecc089ce0 con 0x7fdecc089480 2019-12-19T22:08:13.635 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.630+0000 7fded237a700 1 -- 172.21.15.50:0/1467631868 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdecc08edb0 con 0x7fdecc0898b0 2019-12-19T22:08:13.635 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.630+0000 7fded237a700 1 --2- 172.21.15.50:0/1467631868 >> v2:172.21.15.50:3300/0 conn(0x7fdecc0898b0 0x7fdecc081170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdebc008790 tx=0x7fdebc00fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.635 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.630+0000 7fded237a700 1 --2- 172.21.15.50:0/1467631868 >> v2:172.21.15.50:3300/0 conn(0x7fdecc0898b0 0x7fdecc081170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdebc008790 tx=0x7fdebc00fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.635 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.630+0000 7fded237a700 1 --2- 172.21.15.50:0/1467631868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdecc0898b0 0x7fdecc081170 secure :-1 s=READY pgs=155 cs=0 l=1 rx=0x7fdebc008790 tx=0x7fdebc00fbf0).ready entity=mon.0 client_cookie=4f892f39b0d36b4d server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:13.636 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.630+0000 7fded237a700 1 --2- 172.21.15.50:0/1467631868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdecc0898b0 0x7fdecc081170 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7fdebc008790 tx=0x7fdebc00fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.636 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.630+0000 7fded1b79700 1 -- 172.21.15.50:0/1467631868 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fdebc011270 con 0x7fdecc0898b0 2019-12-19T22:08:13.636 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.630+0000 7fded237a700 1 --2- 172.21.15.50:0/1467631868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdecc0898b0 0x7fdecc081170 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7fdebc008790 tx=0x7fdebc00fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.636 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.630+0000 7fded237a700 1 --2- 172.21.15.50:0/1467631868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdecc0898b0 0x7fdecc081170 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7fdebc008790 tx=0x7fdebc00fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.638 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.630+0000 7fded1b79700 1 -- 172.21.15.50:0/1467631868 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdebc011470 con 0x7fdecc0898b0 2019-12-19T22:08:13.638 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.630+0000 7fded1b79700 1 -- 172.21.15.50:0/1467631868 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fdebc011790 con 0x7fdecc0898b0 2019-12-19T22:08:13.638 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.630+0000 7fded45de700 1 -- 172.21.15.50:0/1467631868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdecc0898b0 msgr2=0x7fdecc081170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:13.638 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.630+0000 7fded45de700 1 --2- 172.21.15.50:0/1467631868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdecc0898b0 0x7fdecc081170 secure :-1 s=READY pgs=155 cs=0 l=1 rx=0x7fdebc008790 tx=0x7fdebc00fbf0).stop 2019-12-19T22:08:13.638 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.630+0000 7fded45de700 1 -- 172.21.15.50:0/1467631868 shutdown_connections 2019-12-19T22:08:13.638 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.630+0000 7fded45de700 1 --2- 172.21.15.50:0/1467631868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdecc0898b0 0x7fdecc081170 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:13.638 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.630+0000 7fded45de700 1 -- 172.21.15.50:0/1467631868 shutdown_connections 2019-12-19T22:08:13.639 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.630+0000 7fded45de700 1 -- 172.21.15.50:0/1467631868 wait complete. 2019-12-19T22:08:13.639 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.630+0000 7fded45de700 1 -- 172.21.15.50:0/1467631868 >> 172.21.15.50:0/1467631868 conn(0x7fdecc067e70 msgr2=0x7fdecc094570 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:13.639 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.631+0000 7fded45de700 1 Processor -- start 2019-12-19T22:08:13.639 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.631+0000 7fded45de700 1 -- start start 2019-12-19T22:08:13.642 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.632+0000 7fded45de700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdecc1216e0 0x7fdecc123b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:13.642 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.632+0000 7fded45de700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdecc062090 con 0x7fdecc0605a0 2019-12-19T22:08:13.642 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.632+0000 7fded45de700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdecc063b90 con 0x7fdecc1216e0 2019-12-19T22:08:13.642 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.632+0000 7fded237a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdecc1216e0 0x7fdecc123b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:13.642 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.632+0000 7fded237a700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdecc1216e0 0x7fdecc123b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53716/0 (socket says 172.21.15.50:53716) 2019-12-19T22:08:13.642 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.632+0000 7fded237a700 1 -- 172.21.15.50:0/2613535951 learned_addr learned my addr 172.21.15.50:0/2613535951 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:13.642 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.632+0000 7fded237a700 1 -- 172.21.15.50:0/2613535951 >> v1:172.21.15.50:6789/0 conn(0x7fdecc0605a0 legacy=0x7fdecc0609d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:13.643 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.632+0000 7fded237a700 1 -- 172.21.15.50:0/2613535951 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdecc061880 con 0x7fdecc1216e0 2019-12-19T22:08:13.643 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.632+0000 7fded237a700 1 --2- 172.21.15.50:0/2613535951 >> v2:172.21.15.50:3300/0 conn(0x7fdecc1216e0 0x7fdecc123b20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdebc008790 tx=0x7fdebc00f4b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.643 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.632+0000 7fded237a700 1 --2- 172.21.15.50:0/2613535951 >> v2:172.21.15.50:3300/0 conn(0x7fdecc1216e0 0x7fdecc123b20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdebc008790 tx=0x7fdebc00f4b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.643 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.632+0000 7fded237a700 1 --2- 172.21.15.50:0/2613535951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdecc1216e0 0x7fdecc123b20 secure :-1 s=READY pgs=157 cs=0 l=1 rx=0x7fdebc008790 tx=0x7fdebc00f4b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:13.643 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.632+0000 7fded237a700 1 --2- 172.21.15.50:0/2613535951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdecc1216e0 0x7fdecc123b20 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7fdebc008790 tx=0x7fdebc00f4b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.643 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.632+0000 7fded237a700 1 --2- 172.21.15.50:0/2613535951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdecc1216e0 0x7fdecc123b20 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7fdebc008790 tx=0x7fdebc00f4b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.643 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.632+0000 7fdec37fe700 1 -- 172.21.15.50:0/2613535951 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fdebc007150 con 0x7fdecc1216e0 2019-12-19T22:08:13.644 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.632+0000 7fded237a700 1 --2- 172.21.15.50:0/2613535951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdecc1216e0 0x7fdecc123b20 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7fdebc008790 tx=0x7fdebc00f4b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.644 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.632+0000 7fdec37fe700 1 -- 172.21.15.50:0/2613535951 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdebc007350 con 0x7fdecc1216e0 2019-12-19T22:08:13.644 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.632+0000 7fded45de700 1 -- 172.21.15.50:0/2613535951 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdecc0624d0 con 0x7fdecc1216e0 2019-12-19T22:08:13.644 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.632+0000 7fdec37fe700 1 -- 172.21.15.50:0/2613535951 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fdebc0115b0 con 0x7fdecc1216e0 2019-12-19T22:08:13.644 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.632+0000 7fded45de700 1 -- 172.21.15.50:0/2613535951 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdecc089c40 con 0x7fdecc1216e0 2019-12-19T22:08:13.644 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.633+0000 7fded237a700 1 --2- 172.21.15.50:0/2613535951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdecc1216e0 0x7fdecc123b20 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7fdebc008790 tx=0x7fdebc00f4b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.644 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.633+0000 7fdec37fe700 1 -- 172.21.15.50:0/2613535951 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7fdebc005540 con 0x7fdecc1216e0 2019-12-19T22:08:13.645 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.633+0000 7fded237a700 1 --2- 172.21.15.50:0/2613535951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdecc1216e0 0x7fdecc123b20 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7fdebc008790 tx=0x7fdebc00f4b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.645 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.633+0000 7fdec37fe700 1 --2- 172.21.15.50:0/2613535951 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fdeb401fa50 0x7fdeb4021f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:13.645 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.633+0000 7fdec37fe700 1 -- 172.21.15.50:0/2613535951 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3403+0+0 (secure 0 0 0) 0x7fdebc02ad30 con 0x7fdecc1216e0 2019-12-19T22:08:13.645 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.633+0000 7fded2b7b700 1 --2- 172.21.15.50:0/2613535951 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fdeb401fa50 0x7fdeb4021f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:13.645 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.633+0000 7fded2b7b700 1 --2- 172.21.15.50:0/2613535951 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fdeb401fa50 0x7fdeb4021f60 crc :-1 s=READY pgs=38 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:13.645 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.634+0000 7fded45de700 1 -- 172.21.15.50:0/2613535951 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdecc056340 con 0x7fdecc1216e0 2019-12-19T22:08:13.645 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.637+0000 7fded237a700 1 --2- 172.21.15.50:0/2613535951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdecc1216e0 0x7fdecc123b20 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7fdebc008790 tx=0x7fdebc00f4b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.646 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.637+0000 7fdec37fe700 1 -- 172.21.15.50:0/2613535951 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7fdebc005d70 con 0x7fdecc1216e0 2019-12-19T22:08:13.782 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.770+0000 7fded45de700 1 -- 172.21.15.50:0/2613535951 --> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdecc07e6d0 con 0x7fdeb401fa50 2019-12-19T22:08:13.782 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.772+0000 7fdec37fe700 1 -- 172.21.15.50:0/2613535951 <== mgr.4103 v2:172.21.15.50:6824/27190 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+64132 (crc 0 0 0) 0x7fdecc07e6d0 con 0x7fdeb401fa50 2019-12-19T22:08:13.782 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.773+0000 7fded45de700 1 -- 172.21.15.50:0/2613535951 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fdeb401fa50 msgr2=0x7fdeb4021f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:13.783 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.773+0000 7fded45de700 1 --2- 172.21.15.50:0/2613535951 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fdeb401fa50 0x7fdeb4021f60 crc :-1 s=READY pgs=38 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:13.783 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.773+0000 7fded45de700 1 -- 172.21.15.50:0/2613535951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdecc1216e0 msgr2=0x7fdecc123b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:13.783 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.773+0000 7fded45de700 1 --2- 172.21.15.50:0/2613535951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdecc1216e0 0x7fdecc123b20 secure :-1 s=READY pgs=157 cs=0 l=1 rx=0x7fdebc008790 tx=0x7fdebc00f4b0).stop 2019-12-19T22:08:13.783 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.773+0000 7fded45de700 1 -- 172.21.15.50:0/2613535951 shutdown_connections 2019-12-19T22:08:13.783 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.773+0000 7fded45de700 1 --2- 172.21.15.50:0/2613535951 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fdeb401fa50 0x7fdeb4021f60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:13.783 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.773+0000 7fded45de700 1 --2- 172.21.15.50:0/2613535951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdecc1216e0 0x7fdecc123b20 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:13.784 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.773+0000 7fded45de700 1 -- 172.21.15.50:0/2613535951 shutdown_connections 2019-12-19T22:08:13.784 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.773+0000 7fded45de700 1 -- 172.21.15.50:0/2613535951 wait complete. 2019-12-19T22:08:13.784 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.773+0000 7fded45de700 1 -- 172.21.15.50:0/2613535951 >> 172.21.15.50:0/2613535951 conn(0x7fdecc081c00 msgr2=0x7fdecc08cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:13.784 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2019-12-19T22:08:13.785 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:08:13.788 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2019-12-19T22:08:11.887823+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":48,"acting":48,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":3146248,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":3145728,"kb_avail":311426552,"statfs":{"total":322122547200,"available":318900789248,"internally_reserved":3221225472,"allocated":507904,"data_stored":139200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3221225472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"3.7","version":"0'0","reported_seq":"9","reported_epoch":"16","state":"active+clean","last_fresh":"2019-12-19T22:08:06.718391+0000","last_change":"2019-12-19T22:08:06.718253+0000","last_active":"2019-12-19T22:08:06.718391+0000","last_peered":"2019-12-19T22:08:06.718391+0000","last_clean":"2019-12-19T22:08:06.718391+0000","last_became_active":"2019-12-19T22:08:06.717951+0000","last_became_peered":"2019-12-19T22:08:06.717951+0000","last_unstale":"2019-12-19T22:08:06.718391+0000","last_undegraded":"2019-12-19T22:08:06.718391+0000","last_fullsized":"2019-12-19T22:08:06.718391+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_clean_scrub_stamp":"2019-12-19T22:08:06.374096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"12","reported_epoch":"16","state":"active+clean","last_fresh":"2019-12-19T22:08:06.715852+0000","last_change":"2019-12-19T22:08:03.376599+0000","last_active":"2019-12-19T22:08:06.715852+0000","last_peered":"2019-12-19T22:08:06.715852+0000","last_clean":"2019-12-19T22:08:06.715852+0000","last_became_active":"2019-12-19T22:08:03.376233+0000","last_became_peered":"2019-12-19T22:08:03.376233+0000","last_unstale":"2019-12-19T22:08:06.715852+0000","last_undegraded":"2019-12-19T22:08:06.715852+0000","last_fullsized":"2019-12-19T22:08:06.715852+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_clean_scrub_stamp":"2019-12-19T22:08:02.364860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"17'3","reported_seq":"13","reported_epoch":"17","state":"active+clean","last_fresh":"2019-12-19T22:08:09.724569+0000","last_change":"2019-12-19T22:08:06.383420+0000","last_active":"2019-12-19T22:08:09.724569+0000","last_peered":"2019-12-19T22:08:09.724569+0000","last_clean":"2019-12-19T22:08:09.724569+0000","last_became_active":"2019-12-19T22:08:06.382998+0000","last_became_peered":"2019-12-19T22:08:06.382998+0000","last_unstale":"2019-12-19T22:08:09.724569+0000","last_undegraded":"2019-12-19T22:08:09.724569+0000","last_fullsized":"2019-12-19T22:08:09.724569+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_clean_scrub_stamp":"2019-12-19T22:08:05.371035+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"9","reported_epoch":"16","state":"active+clean","last_fresh":"2019-12-19T22:08:06.716134+0000","last_change":"2019-12-19T22:08:06.715884+0000","last_active":"2019-12-19T22:08:06.716134+0000","last_peered":"2019-12-19T22:08:06.716134+0000","last_clean":"2019-12-19T22:08:06.716134+0000","last_became_active":"2019-12-19T22:08:06.715475+0000","last_became_peered":"2019-12-19T22:08:06.715475+0000","last_unstale":"2019-12-19T22:08:06.716134+0000","last_undegraded":"2019-12-19T22:08:06.716134+0000","last_fullsized":"2019-12-19T22:08:06.716134+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_clean_scrub_stamp":"2019-12-19T22:08:06.374096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"13","reported_epoch":"16","state":"active+clean","last_fresh":"2019-12-19T22:08:06.713912+0000","last_change":"2019-12-19T22:08:03.374278+0000","last_active":"2019-12-19T22:08:06.713912+0000","last_peered":"2019-12-19T22:08:06.713912+0000","last_clean":"2019-12-19T22:08:06.713912+0000","last_became_active":"2019-12-19T22:08:03.373911+0000","last_became_peered":"2019-12-19T22:08:03.373911+0000","last_unstale":"2019-12-19T22:08:06.713912+0000","last_undegraded":"2019-12-19T22:08:06.713912+0000","last_fullsized":"2019-12-19T22:08:06.713912+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_clean_scrub_stamp":"2019-12-19T22:08:02.364860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"17'7","reported_seq":"17","reported_epoch":"17","state":"active+clean","last_fresh":"2019-12-19T22:08:09.726588+0000","last_change":"2019-12-19T22:08:06.383498+0000","last_active":"2019-12-19T22:08:09.726588+0000","last_peered":"2019-12-19T22:08:09.726588+0000","last_clean":"2019-12-19T22:08:09.726588+0000","last_became_active":"2019-12-19T22:08:06.382983+0000","last_became_peered":"2019-12-19T22:08:06.382983+0000","last_unstale":"2019-12-19T22:08:09.726588+0000","last_undegraded":"2019-12-19T22:08:09.726588+0000","last_fullsized":"2019-12-19T22:08:09.726588+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_clean_scrub_stamp":"2019-12-19T22:08:05.371035+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"9","reported_epoch":"16","state":"active+clean","last_fresh":"2019-12-19T22:08:06.717414+0000","last_change":"2019-12-19T22:08:06.716855+0000","last_active":"2019-12-19T22:08:06.717414+0000","last_peered":"2019-12-19T22:08:06.717414+0000","last_clean":"2019-12-19T22:08:06.717414+0000","last_became_active":"2019-12-19T22:08:06.716480+0000","last_became_peered":"2019-12-19T22:08:06.716480+0000","last_unstale":"2019-12-19T22:08:06.717414+0000","last_undegraded":"2019-12-19T22:08:06.717414+0000","last_fullsized":"2019-12-19T22:08:06.717414+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_clean_scrub_stamp":"2019-12-19T22:08:06.374096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"13","reported_epoch":"16","state":"active+clean","last_fresh":"2019-12-19T22:08:06.713734+0000","last_change":"2019-12-19T22:08:03.373620+0000","last_active":"2019-12-19T22:08:06.713734+0000","last_peered":"2019-12-19T22:08:06.713734+0000","last_clean":"2019-12-19T22:08:06.713734+0000","last_became_active":"2019-12-19T22:08:03.373242+0000","last_became_peered":"2019-12-19T22:08:03.373242+0000","last_unstale":"2019-12-19T22:08:06.713734+0000","last_undegraded":"2019-12-19T22:08:06.713734+0000","last_fullsized":"2019-12-19T22:08:06.713734+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_clean_scrub_stamp":"2019-12-19T22:08:02.364860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'8","reported_seq":"18","reported_epoch":"17","state":"active+clean","last_fresh":"2019-12-19T22:08:09.726787+0000","last_change":"2019-12-19T22:08:06.384597+0000","last_active":"2019-12-19T22:08:09.726787+0000","last_peered":"2019-12-19T22:08:09.726787+0000","last_clean":"2019-12-19T22:08:09.726787+0000","last_became_active":"2019-12-19T22:08:06.383672+0000","last_became_peered":"2019-12-19T22:08:06.383672+0000","last_unstale":"2019-12-19T22:08:09.726787+0000","last_undegraded":"2019-12-19T22:08:09.726787+0000","last_fullsized":"2019-12-19T22:08:09.726787+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_clean_scrub_stamp":"2019-12-19T22:08:05.371035+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"9","reported_epoch":"16","state":"active+clean","last_fresh":"2019-12-19T22:08:06.717603+0000","last_change":"2019-12-19T22:08:06.717297+0000","last_active":"2019-12-19T22:08:06.717603+0000","last_peered":"2019-12-19T22:08:06.717603+0000","last_clean":"2019-12-19T22:08:06.717603+0000","last_became_active":"2019-12-19T22:08:06.717028+0000","last_became_peered":"2019-12-19T22:08:06.717028+0000","last_unstale":"2019-12-19T22:08:06.717603+0000","last_undegraded":"2019-12-19T22:08:06.717603+0000","last_fullsized":"2019-12-19T22:08:06.717603+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_clean_scrub_stamp":"2019-12-19T22:08:06.374096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"13","reported_epoch":"16","state":"active+clean","last_fresh":"2019-12-19T22:08:06.712375+0000","last_change":"2019-12-19T22:08:03.375294+0000","last_active":"2019-12-19T22:08:06.712375+0000","last_peered":"2019-12-19T22:08:06.712375+0000","last_clean":"2019-12-19T22:08:06.712375+0000","last_became_active":"2019-12-19T22:08:03.374963+0000","last_became_peered":"2019-12-19T22:08:03.374963+0000","last_unstale":"2019-12-19T22:08:06.712375+0000","last_undegraded":"2019-12-19T22:08:06.712375+0000","last_fullsized":"2019-12-19T22:08:06.712375+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_clean_scrub_stamp":"2019-12-19T22:08:02.364860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"10","reported_epoch":"16","state":"active+clean","last_fresh":"2019-12-19T22:08:06.715552+0000","last_change":"2019-12-19T22:08:06.384407+0000","last_active":"2019-12-19T22:08:06.715552+0000","last_peered":"2019-12-19T22:08:06.715552+0000","last_clean":"2019-12-19T22:08:06.715552+0000","last_became_active":"2019-12-19T22:08:06.383871+0000","last_became_peered":"2019-12-19T22:08:06.383871+0000","last_unstale":"2019-12-19T22:08:06.715552+0000","last_undegraded":"2019-12-19T22:08:06.715552+0000","last_fullsized":"2019-12-19T22:08:06.715552+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_clean_scrub_stamp":"2019-12-19T22:08:05.371035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"9","reported_epoch":"16","state":"active+clean","last_fresh":"2019-12-19T22:08:06.717674+0000","last_change":"2019-12-19T22:08:06.717430+0000","last_active":"2019-12-19T22:08:06.717674+0000","last_peered":"2019-12-19T22:08:06.717674+0000","last_clean":"2019-12-19T22:08:06.717674+0000","last_became_active":"2019-12-19T22:08:06.717085+0000","last_became_peered":"2019-12-19T22:08:06.717085+0000","last_unstale":"2019-12-19T22:08:06.717674+0000","last_undegraded":"2019-12-19T22:08:06.717674+0000","last_fullsized":"2019-12-19T22:08:06.717674+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_clean_scrub_stamp":"2019-12-19T22:08:06.374096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"13","reported_epoch":"16","state":"active+clean","last_fresh":"2019-12-19T22:08:06.713955+0000","last_change":"2019-12-19T22:08:03.375817+0000","last_active":"2019-12-19T22:08:06.713955+0000","last_peered":"2019-12-19T22:08:06.713955+0000","last_clean":"2019-12-19T22:08:06.713955+0000","last_became_active":"2019-12-19T22:08:03.375549+0000","last_became_peered":"2019-12-19T22:08:03.375549+0000","last_unstale":"2019-12-19T22:08:06.713955+0000","last_undegraded":"2019-12-19T22:08:06.713955+0000","last_fullsized":"2019-12-19T22:08:06.713955+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_clean_scrub_stamp":"2019-12-19T22:08:02.364860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'5","reported_seq":"15","reported_epoch":"17","state":"active+clean","last_fresh":"2019-12-19T22:08:09.725614+0000","last_change":"2019-12-19T22:08:06.382991+0000","last_active":"2019-12-19T22:08:09.725614+0000","last_peered":"2019-12-19T22:08:09.725614+0000","last_clean":"2019-12-19T22:08:09.725614+0000","last_became_active":"2019-12-19T22:08:06.382299+0000","last_became_peered":"2019-12-19T22:08:06.382299+0000","last_unstale":"2019-12-19T22:08:09.725614+0000","last_undegraded":"2019-12-19T22:08:09.725614+0000","last_fullsized":"2019-12-19T22:08:09.725614+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_clean_scrub_stamp":"2019-12-19T22:08:05.371035+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"9","reported_epoch":"16","state":"active+clean","last_fresh":"2019-12-19T22:08:06.717389+0000","last_change":"2019-12-19T22:08:06.716759+0000","last_active":"2019-12-19T22:08:06.717389+0000","last_peered":"2019-12-19T22:08:06.717389+0000","last_clean":"2019-12-19T22:08:06.717389+0000","last_became_active":"2019-12-19T22:08:06.716445+0000","last_became_peered":"2019-12-19T22:08:06.716445+0000","last_unstale":"2019-12-19T22:08:06.717389+0000","last_undegraded":"2019-12-19T22:08:06.717389+0000","last_fullsized":"2019-12-19T22:08:06.717389+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_clean_scrub_stamp":"2019-12-19T22:08:06.374096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"12","reported_epoch":"16","state":"active+clean","last_fresh":"2019-12-19T22:08:06.715442+0000","last_change":"2019-12-19T22:08:03.374496+0000","last_active":"2019-12-19T22:08:06.715442+0000","last_peered":"2019-12-19T22:08:06.715442+0000","last_clean":"2019-12-19T22:08:06.715442+0000","last_became_active":"2019-12-19T22:08:03.373999+0000","last_became_peered":"2019-12-19T22:08:03.373999+0000","last_unstale":"2019-12-19T22:08:06.715442+0000","last_undegraded":"2019-12-19T22:08:06.715442+0000","last_fullsized":"2019-12-19T22:08:06.715442+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_clean_scrub_stamp":"2019-12-19T22:08:02.364860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"17'1","reported_seq":"11","reported_epoch":"17","state":"active+clean","last_fresh":"2019-12-19T22:08:08.271417+0000","last_change":"2019-12-19T22:08:06.383835+0000","last_active":"2019-12-19T22:08:08.271417+0000","last_peered":"2019-12-19T22:08:08.271417+0000","last_clean":"2019-12-19T22:08:08.271417+0000","last_became_active":"2019-12-19T22:08:06.383420+0000","last_became_peered":"2019-12-19T22:08:06.383420+0000","last_unstale":"2019-12-19T22:08:08.271417+0000","last_undegraded":"2019-12-19T22:08:08.271417+0000","last_fullsized":"2019-12-19T22:08:08.271417+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_clean_scrub_stamp":"2019-12-19T22:08:05.371035+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"9","reported_epoch":"16","state":"active+clean","last_fresh":"2019-12-19T22:08:06.717881+0000","last_change":"2019-12-19T22:08:06.717641+0000","last_active":"2019-12-19T22:08:06.717881+0000","last_peered":"2019-12-19T22:08:06.717881+0000","last_clean":"2019-12-19T22:08:06.717881+0000","last_became_active":"2019-12-19T22:08:06.717289+0000","last_became_peered":"2019-12-19T22:08:06.717289+0000","last_unstale":"2019-12-19T22:08:06.717881+0000","last_undegraded":"2019-12-19T22:08:06.717881+0000","last_fullsized":"2019-12-19T22:08:06.717881+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_clean_scrub_stamp":"2019-12-19T22:08:06.374096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"13","reported_epoch":"16","state":"active+clean","last_fresh":"2019-12-19T22:08:06.713577+0000","last_change":"2019-12-19T22:08:03.375588+0000","last_active":"2019-12-19T22:08:06.713577+0000","last_peered":"2019-12-19T22:08:06.713577+0000","last_clean":"2019-12-19T22:08:06.713577+0000","last_became_active":"2019-12-19T22:08:03.375236+0000","last_became_peered":"2019-12-19T22:08:03.375236+0000","last_unstale":"2019-12-19T22:08:06.713577+0000","last_undegraded":"2019-12-19T22:08:06.713577+0000","last_fullsized":"2019-12-19T22:08:06.713577+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_clean_scrub_stamp":"2019-12-19T22:08:02.364860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"17'6","reported_seq":"16","reported_epoch":"17","state":"active+clean","last_fresh":"2019-12-19T22:08:09.725171+0000","last_change":"2019-12-19T22:08:06.382924+0000","last_active":"2019-12-19T22:08:09.725171+0000","last_peered":"2019-12-19T22:08:09.725171+0000","last_clean":"2019-12-19T22:08:09.725171+0000","last_became_active":"2019-12-19T22:08:06.382181+0000","last_became_peered":"2019-12-19T22:08:06.382181+0000","last_unstale":"2019-12-19T22:08:09.725171+0000","last_undegraded":"2019-12-19T22:08:09.725171+0000","last_fullsized":"2019-12-19T22:08:09.725171+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_clean_scrub_stamp":"2019-12-19T22:08:05.371035+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"9","reported_epoch":"16","state":"active+clean","last_fresh":"2019-12-19T22:08:06.718689+0000","last_change":"2019-12-19T22:08:06.718506+0000","last_active":"2019-12-19T22:08:06.718689+0000","last_peered":"2019-12-19T22:08:06.718689+0000","last_clean":"2019-12-19T22:08:06.718689+0000","last_became_active":"2019-12-19T22:08:06.718242+0000","last_became_peered":"2019-12-19T22:08:06.718242+0000","last_unstale":"2019-12-19T22:08:06.718689+0000","last_undegraded":"2019-12-19T22:08:06.718689+0000","last_fullsized":"2019-12-19T22:08:06.718689+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_clean_scrub_stamp":"2019-12-19T22:08:06.374096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"13","reported_epoch":"16","state":"active+clean","last_fresh":"2019-12-19T22:08:06.714895+0000","last_change":"2019-12-19T22:08:03.373237+0000","last_active":"2019-12-19T22:08:06.714895+0000","last_peered":"2019-12-19T22:08:06.714895+0000","last_clean":"2019-12-19T22:08:06.714895+0000","last_became_active":"2019-12-19T22:08:03.372918+0000","last_became_peered":"2019-12-19T22:08:03.372918+0000","last_unstale":"2019-12-19T22:08:06.714895+0000","last_undegraded":"2019-12-19T22:08:06.714895+0000","last_fullsized":"2019-12-19T22:08:06.714895+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_clean_scrub_stamp":"2019-12-19T22:08:02.364860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"17'8","reported_seq":"18","reported_epoch":"17","state":"active+clean","last_fresh":"2019-12-19T22:08:09.727376+0000","last_change":"2019-12-19T22:08:06.385018+0000","last_active":"2019-12-19T22:08:09.727376+0000","last_peered":"2019-12-19T22:08:09.727376+0000","last_clean":"2019-12-19T22:08:09.727376+0000","last_became_active":"2019-12-19T22:08:06.384716+0000","last_became_peered":"2019-12-19T22:08:06.384716+0000","last_unstale":"2019-12-19T22:08:09.727376+0000","last_undegraded":"2019-12-19T22:08:09.727376+0000","last_fullsized":"2019-12-19T22:08:09.727376+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_clean_scrub_stamp":"2019-12-19T22:08:05.371035+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1526,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048760,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808840,"statfs":{"total":107374182400,"available":106300252160,"internally_reserved":1073741824,"allocated":180224,"data_stored":47162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.436}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.400}]}]},{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048732,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808868,"statfs":{"total":107374182400,"available":106300280832,"internally_reserved":1073741824,"allocated":151552,"data_stored":44910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.335}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.258}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808844,"statfs":{"total":107374182400,"available":106300256256,"internally_reserved":1073741824,"allocated":176128,"data_stored":47128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.310}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.270}]}]}]}} 2019-12-19T22:08:13.795 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2019-12-19T22:08:13.925 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.915+0000 7f08229c2700 1 Processor -- start 2019-12-19T22:08:13.925 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.916+0000 7f08229c2700 1 -- start start 2019-12-19T22:08:13.925 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.916+0000 7f08229c2700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f081c07d340 0x7f081c074f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:13.925 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.916+0000 7f08229c2700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f081c064060 con 0x7f081c07cf10 2019-12-19T22:08:13.926 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.916+0000 7f08229c2700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f081c08ae60 con 0x7f081c07d340 2019-12-19T22:08:13.926 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.916+0000 7f08219c0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f081c07d340 0x7f081c074f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:13.926 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.916+0000 7f08221c1700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f081c07cf10 0x7f081c063680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39848/0 (socket says 172.21.15.50:39848) 2019-12-19T22:08:13.926 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.916+0000 7f08221c1700 1 -- 172.21.15.50:0/3287499667 learned_addr learned my addr 172.21.15.50:0/3287499667 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:13.926 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.916+0000 7f08219c0700 1 -- 172.21.15.50:0/3287499667 >> v1:172.21.15.50:6789/0 conn(0x7f081c07cf10 legacy=0x7f081c063680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:13.926 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.916+0000 7f08219c0700 1 -- 172.21.15.50:0/3287499667 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f081c07c650 con 0x7f081c07d340 2019-12-19T22:08:13.926 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.917+0000 7f08219c0700 1 --2- 172.21.15.50:0/3287499667 >> v2:172.21.15.50:3300/0 conn(0x7f081c07d340 0x7f081c074f50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0818008790 tx=0x7f081800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.926 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.917+0000 7f08219c0700 1 --2- 172.21.15.50:0/3287499667 >> v2:172.21.15.50:3300/0 conn(0x7f081c07d340 0x7f081c074f50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0818008790 tx=0x7f081800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.927 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.917+0000 7f08219c0700 1 --2- 172.21.15.50:0/3287499667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f081c07d340 0x7f081c074f50 secure :-1 s=READY pgs=159 cs=0 l=1 rx=0x7f0818008790 tx=0x7f081800fbf0).ready entity=mon.0 client_cookie=bedcf781be89e28c server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:13.927 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.917+0000 7f08219c0700 1 --2- 172.21.15.50:0/3287499667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f081c07d340 0x7f081c074f50 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f0818008790 tx=0x7f081800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.927 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.917+0000 7f08211bf700 1 -- 172.21.15.50:0/3287499667 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f0818011270 con 0x7f081c07d340 2019-12-19T22:08:13.927 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.917+0000 7f08219c0700 1 --2- 172.21.15.50:0/3287499667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f081c07d340 0x7f081c074f50 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f0818008790 tx=0x7f081800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.927 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.917+0000 7f08211bf700 1 -- 172.21.15.50:0/3287499667 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0818011470 con 0x7f081c07d340 2019-12-19T22:08:13.927 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.917+0000 7f08219c0700 1 --2- 172.21.15.50:0/3287499667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f081c07d340 0x7f081c074f50 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f0818008790 tx=0x7f081800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.927 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.917+0000 7f08229c2700 1 -- 172.21.15.50:0/3287499667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f081c07d340 msgr2=0x7f081c074f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:13.928 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.917+0000 7f08211bf700 1 -- 172.21.15.50:0/3287499667 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f0818011790 con 0x7f081c07d340 2019-12-19T22:08:13.928 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.917+0000 7f08229c2700 1 --2- 172.21.15.50:0/3287499667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f081c07d340 0x7f081c074f50 secure :-1 s=READY pgs=159 cs=0 l=1 rx=0x7f0818008790 tx=0x7f081800fbf0).stop 2019-12-19T22:08:13.928 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.917+0000 7f08229c2700 1 -- 172.21.15.50:0/3287499667 shutdown_connections 2019-12-19T22:08:13.928 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.917+0000 7f08229c2700 1 --2- 172.21.15.50:0/3287499667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f081c07d340 0x7f081c074f50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:13.928 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.917+0000 7f08229c2700 1 -- 172.21.15.50:0/3287499667 shutdown_connections 2019-12-19T22:08:13.928 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.917+0000 7f08229c2700 1 -- 172.21.15.50:0/3287499667 wait complete. 2019-12-19T22:08:13.928 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.917+0000 7f08229c2700 1 -- 172.21.15.50:0/3287499667 >> 172.21.15.50:0/3287499667 conn(0x7f081c095890 msgr2=0x7f081c095cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:13.929 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.918+0000 7f08229c2700 1 Processor -- start 2019-12-19T22:08:13.929 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.918+0000 7f08229c2700 1 -- start start 2019-12-19T22:08:13.929 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.919+0000 7f08229c2700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f081c0608f0 0x7f081c060d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:13.929 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.919+0000 7f08229c2700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f081c08c9f0 con 0x7f081c061270 2019-12-19T22:08:13.929 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.919+0000 7f08229c2700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f081c092dc0 con 0x7f081c0608f0 2019-12-19T22:08:13.929 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.919+0000 7f08221c1700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f081c0608f0 0x7f081c060d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:13.929 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.919+0000 7f08221c1700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f081c0608f0 0x7f081c060d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53724/0 (socket says 172.21.15.50:53724) 2019-12-19T22:08:13.930 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.919+0000 7f08221c1700 1 -- 172.21.15.50:0/3887723209 learned_addr learned my addr 172.21.15.50:0/3887723209 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:13.930 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.919+0000 7f08221c1700 1 -- 172.21.15.50:0/3887723209 >> v1:172.21.15.50:6789/0 conn(0x7f081c061270 legacy=0x7f081c125aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:13.930 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.919+0000 7f08221c1700 1 -- 172.21.15.50:0/3887723209 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f081c0616a0 con 0x7f081c0608f0 2019-12-19T22:08:13.930 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.919+0000 7f08221c1700 1 --2- 172.21.15.50:0/3887723209 >> v2:172.21.15.50:3300/0 conn(0x7f081c0608f0 0x7f081c060d20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f080c0043a0 tx=0x7f080c00c400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.930 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.919+0000 7f08221c1700 1 --2- 172.21.15.50:0/3887723209 >> v2:172.21.15.50:3300/0 conn(0x7f081c0608f0 0x7f081c060d20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f080c0043a0 tx=0x7f080c00c400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.930 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.919+0000 7f08221c1700 1 --2- 172.21.15.50:0/3887723209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f081c0608f0 0x7f081c060d20 secure :-1 s=READY pgs=161 cs=0 l=1 rx=0x7f080c0043a0 tx=0x7f080c00c400).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:13.930 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.919+0000 7f08221c1700 1 --2- 172.21.15.50:0/3887723209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f081c0608f0 0x7f081c060d20 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f080c0043a0 tx=0x7f080c00c400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.931 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.919+0000 7f0812ffd700 1 -- 172.21.15.50:0/3887723209 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f080c0115a0 con 0x7f081c0608f0 2019-12-19T22:08:13.931 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.919+0000 7f08221c1700 1 --2- 172.21.15.50:0/3887723209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f081c0608f0 0x7f081c060d20 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f080c0043a0 tx=0x7f080c00c400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.931 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.919+0000 7f0812ffd700 1 -- 172.21.15.50:0/3887723209 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080c0117a0 con 0x7f081c0608f0 2019-12-19T22:08:13.931 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.919+0000 7f08221c1700 1 --2- 172.21.15.50:0/3887723209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f081c0608f0 0x7f081c060d20 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f080c0043a0 tx=0x7f080c00c400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.931 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.919+0000 7f08229c2700 1 -- 172.21.15.50:0/3887723209 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f081c08c500 con 0x7f081c0608f0 2019-12-19T22:08:13.931 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.919+0000 7f0812ffd700 1 -- 172.21.15.50:0/3887723209 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f080c011b00 con 0x7f081c0608f0 2019-12-19T22:08:13.931 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.920+0000 7f08229c2700 1 -- 172.21.15.50:0/3887723209 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f081c08ccd0 con 0x7f081c0608f0 2019-12-19T22:08:13.931 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.920+0000 7f08221c1700 1 --2- 172.21.15.50:0/3887723209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f081c0608f0 0x7f081c060d20 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f080c0043a0 tx=0x7f080c00c400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.932 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.920+0000 7f0812ffd700 1 -- 172.21.15.50:0/3887723209 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7f080c007180 con 0x7f081c0608f0 2019-12-19T22:08:13.932 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.920+0000 7f08221c1700 1 --2- 172.21.15.50:0/3887723209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f081c0608f0 0x7f081c060d20 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f080c0043a0 tx=0x7f080c00c400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.932 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.920+0000 7f0812ffd700 1 --2- 172.21.15.50:0/3887723209 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f080401fa30 0x7f0804021f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:13.932 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.920+0000 7f0812ffd700 1 -- 172.21.15.50:0/3887723209 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3403+0+0 (secure 0 0 0) 0x7f080c029ef0 con 0x7f081c0608f0 2019-12-19T22:08:13.932 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.920+0000 7f08219c0700 1 --2- 172.21.15.50:0/3887723209 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f080401fa30 0x7f0804021f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:13.932 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.920+0000 7f08219c0700 1 --2- 172.21.15.50:0/3887723209 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f080401fa30 0x7f0804021f40 crc :-1 s=READY pgs=39 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:13.932 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.921+0000 7f08229c2700 1 -- 172.21.15.50:0/3887723209 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f081c056340 con 0x7f081c0608f0 2019-12-19T22:08:13.933 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.924+0000 7f08221c1700 1 --2- 172.21.15.50:0/3887723209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f081c0608f0 0x7f081c060d20 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f080c0043a0 tx=0x7f080c00c400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:13.933 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:13.924+0000 7f0812ffd700 1 -- 172.21.15.50:0/3887723209 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7f080c0075d0 con 0x7f081c0608f0 2019-12-19T22:08:14.057 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.055+0000 7f08229c2700 1 -- 172.21.15.50:0/3887723209 --> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f081c061e90 con 0x7f080401fa30 2019-12-19T22:08:14.061 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.057+0000 7f0812ffd700 1 -- 172.21.15.50:0/3887723209 <== mgr.4103 v2:172.21.15.50:6824/27190 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+64084 (crc 0 0 0) 0x7f081c061e90 con 0x7f080401fa30 2019-12-19T22:08:14.061 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.058+0000 7f08229c2700 1 -- 172.21.15.50:0/3887723209 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f080401fa30 msgr2=0x7f0804021f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:14.061 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.058+0000 7f08229c2700 1 --2- 172.21.15.50:0/3887723209 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f080401fa30 0x7f0804021f40 crc :-1 s=READY pgs=39 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:14.061 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.058+0000 7f08229c2700 1 -- 172.21.15.50:0/3887723209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f081c0608f0 msgr2=0x7f081c060d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:14.061 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.058+0000 7f08229c2700 1 --2- 172.21.15.50:0/3887723209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f081c0608f0 0x7f081c060d20 secure :-1 s=READY pgs=161 cs=0 l=1 rx=0x7f080c0043a0 tx=0x7f080c00c400).stop 2019-12-19T22:08:14.061 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.058+0000 7f08229c2700 1 -- 172.21.15.50:0/3887723209 shutdown_connections 2019-12-19T22:08:14.062 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.058+0000 7f08229c2700 1 --2- 172.21.15.50:0/3887723209 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f080401fa30 0x7f0804021f40 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:14.062 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.058+0000 7f08229c2700 1 --2- 172.21.15.50:0/3887723209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f081c0608f0 0x7f081c060d20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:14.062 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.058+0000 7f08229c2700 1 -- 172.21.15.50:0/3887723209 shutdown_connections 2019-12-19T22:08:14.062 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.058+0000 7f08229c2700 1 -- 172.21.15.50:0/3887723209 wait complete. 2019-12-19T22:08:14.062 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.058+0000 7f08229c2700 1 -- 172.21.15.50:0/3887723209 >> 172.21.15.50:0/3887723209 conn(0x7f081c0635b0 msgr2=0x7f081c065140 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:14.062 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:08:14.063 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2019-12-19T22:08:14.071 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2019-12-19T22:08:13.888141+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":48,"acting":48,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":3146248,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":3145728,"kb_avail":311426552,"statfs":{"total":322122547200,"available":318900789248,"internally_reserved":3221225472,"allocated":507904,"data_stored":139200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3221225472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000317"},"pg_stats":[{"pgid":"3.7","version":"0'0","reported_seq":"9","reported_epoch":"16","state":"active+clean","last_fresh":"2019-12-19T22:08:06.718391+0000","last_change":"2019-12-19T22:08:06.718253+0000","last_active":"2019-12-19T22:08:06.718391+0000","last_peered":"2019-12-19T22:08:06.718391+0000","last_clean":"2019-12-19T22:08:06.718391+0000","last_became_active":"2019-12-19T22:08:06.717951+0000","last_became_peered":"2019-12-19T22:08:06.717951+0000","last_unstale":"2019-12-19T22:08:06.718391+0000","last_undegraded":"2019-12-19T22:08:06.718391+0000","last_fullsized":"2019-12-19T22:08:06.718391+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_clean_scrub_stamp":"2019-12-19T22:08:06.374096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"12","reported_epoch":"16","state":"active+clean","last_fresh":"2019-12-19T22:08:06.715852+0000","last_change":"2019-12-19T22:08:03.376599+0000","last_active":"2019-12-19T22:08:06.715852+0000","last_peered":"2019-12-19T22:08:06.715852+0000","last_clean":"2019-12-19T22:08:06.715852+0000","last_became_active":"2019-12-19T22:08:03.376233+0000","last_became_peered":"2019-12-19T22:08:03.376233+0000","last_unstale":"2019-12-19T22:08:06.715852+0000","last_undegraded":"2019-12-19T22:08:06.715852+0000","last_fullsized":"2019-12-19T22:08:06.715852+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_clean_scrub_stamp":"2019-12-19T22:08:02.364860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"17'3","reported_seq":"13","reported_epoch":"17","state":"active+clean","last_fresh":"2019-12-19T22:08:09.724569+0000","last_change":"2019-12-19T22:08:06.383420+0000","last_active":"2019-12-19T22:08:09.724569+0000","last_peered":"2019-12-19T22:08:09.724569+0000","last_clean":"2019-12-19T22:08:09.724569+0000","last_became_active":"2019-12-19T22:08:06.382998+0000","last_became_peered":"2019-12-19T22:08:06.382998+0000","last_unstale":"2019-12-19T22:08:09.724569+0000","last_undegraded":"2019-12-19T22:08:09.724569+0000","last_fullsized":"2019-12-19T22:08:09.724569+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_clean_scrub_stamp":"2019-12-19T22:08:05.371035+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"9","reported_epoch":"16","state":"active+clean","last_fresh":"2019-12-19T22:08:06.716134+0000","last_change":"2019-12-19T22:08:06.715884+0000","last_active":"2019-12-19T22:08:06.716134+0000","last_peered":"2019-12-19T22:08:06.716134+0000","last_clean":"2019-12-19T22:08:06.716134+0000","last_became_active":"2019-12-19T22:08:06.715475+0000","last_became_peered":"2019-12-19T22:08:06.715475+0000","last_unstale":"2019-12-19T22:08:06.716134+0000","last_undegraded":"2019-12-19T22:08:06.716134+0000","last_fullsized":"2019-12-19T22:08:06.716134+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_clean_scrub_stamp":"2019-12-19T22:08:06.374096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"13","reported_epoch":"16","state":"active+clean","last_fresh":"2019-12-19T22:08:06.713912+0000","last_change":"2019-12-19T22:08:03.374278+0000","last_active":"2019-12-19T22:08:06.713912+0000","last_peered":"2019-12-19T22:08:06.713912+0000","last_clean":"2019-12-19T22:08:06.713912+0000","last_became_active":"2019-12-19T22:08:03.373911+0000","last_became_peered":"2019-12-19T22:08:03.373911+0000","last_unstale":"2019-12-19T22:08:06.713912+0000","last_undegraded":"2019-12-19T22:08:06.713912+0000","last_fullsized":"2019-12-19T22:08:06.713912+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_clean_scrub_stamp":"2019-12-19T22:08:02.364860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"17'7","reported_seq":"17","reported_epoch":"17","state":"active+clean","last_fresh":"2019-12-19T22:08:09.726588+0000","last_change":"2019-12-19T22:08:06.383498+0000","last_active":"2019-12-19T22:08:09.726588+0000","last_peered":"2019-12-19T22:08:09.726588+0000","last_clean":"2019-12-19T22:08:09.726588+0000","last_became_active":"2019-12-19T22:08:06.382983+0000","last_became_peered":"2019-12-19T22:08:06.382983+0000","last_unstale":"2019-12-19T22:08:09.726588+0000","last_undegraded":"2019-12-19T22:08:09.726588+0000","last_fullsized":"2019-12-19T22:08:09.726588+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_clean_scrub_stamp":"2019-12-19T22:08:05.371035+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"9","reported_epoch":"16","state":"active+clean","last_fresh":"2019-12-19T22:08:06.717414+0000","last_change":"2019-12-19T22:08:06.716855+0000","last_active":"2019-12-19T22:08:06.717414+0000","last_peered":"2019-12-19T22:08:06.717414+0000","last_clean":"2019-12-19T22:08:06.717414+0000","last_became_active":"2019-12-19T22:08:06.716480+0000","last_became_peered":"2019-12-19T22:08:06.716480+0000","last_unstale":"2019-12-19T22:08:06.717414+0000","last_undegraded":"2019-12-19T22:08:06.717414+0000","last_fullsized":"2019-12-19T22:08:06.717414+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_clean_scrub_stamp":"2019-12-19T22:08:06.374096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"13","reported_epoch":"16","state":"active+clean","last_fresh":"2019-12-19T22:08:06.713734+0000","last_change":"2019-12-19T22:08:03.373620+0000","last_active":"2019-12-19T22:08:06.713734+0000","last_peered":"2019-12-19T22:08:06.713734+0000","last_clean":"2019-12-19T22:08:06.713734+0000","last_became_active":"2019-12-19T22:08:03.373242+0000","last_became_peered":"2019-12-19T22:08:03.373242+0000","last_unstale":"2019-12-19T22:08:06.713734+0000","last_undegraded":"2019-12-19T22:08:06.713734+0000","last_fullsized":"2019-12-19T22:08:06.713734+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_clean_scrub_stamp":"2019-12-19T22:08:02.364860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'8","reported_seq":"18","reported_epoch":"17","state":"active+clean","last_fresh":"2019-12-19T22:08:09.726787+0000","last_change":"2019-12-19T22:08:06.384597+0000","last_active":"2019-12-19T22:08:09.726787+0000","last_peered":"2019-12-19T22:08:09.726787+0000","last_clean":"2019-12-19T22:08:09.726787+0000","last_became_active":"2019-12-19T22:08:06.383672+0000","last_became_peered":"2019-12-19T22:08:06.383672+0000","last_unstale":"2019-12-19T22:08:09.726787+0000","last_undegraded":"2019-12-19T22:08:09.726787+0000","last_fullsized":"2019-12-19T22:08:09.726787+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_clean_scrub_stamp":"2019-12-19T22:08:05.371035+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"9","reported_epoch":"16","state":"active+clean","last_fresh":"2019-12-19T22:08:06.717603+0000","last_change":"2019-12-19T22:08:06.717297+0000","last_active":"2019-12-19T22:08:06.717603+0000","last_peered":"2019-12-19T22:08:06.717603+0000","last_clean":"2019-12-19T22:08:06.717603+0000","last_became_active":"2019-12-19T22:08:06.717028+0000","last_became_peered":"2019-12-19T22:08:06.717028+0000","last_unstale":"2019-12-19T22:08:06.717603+0000","last_undegraded":"2019-12-19T22:08:06.717603+0000","last_fullsized":"2019-12-19T22:08:06.717603+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_clean_scrub_stamp":"2019-12-19T22:08:06.374096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"13","reported_epoch":"16","state":"active+clean","last_fresh":"2019-12-19T22:08:06.712375+0000","last_change":"2019-12-19T22:08:03.375294+0000","last_active":"2019-12-19T22:08:06.712375+0000","last_peered":"2019-12-19T22:08:06.712375+0000","last_clean":"2019-12-19T22:08:06.712375+0000","last_became_active":"2019-12-19T22:08:03.374963+0000","last_became_peered":"2019-12-19T22:08:03.374963+0000","last_unstale":"2019-12-19T22:08:06.712375+0000","last_undegraded":"2019-12-19T22:08:06.712375+0000","last_fullsized":"2019-12-19T22:08:06.712375+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_clean_scrub_stamp":"2019-12-19T22:08:02.364860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"10","reported_epoch":"16","state":"active+clean","last_fresh":"2019-12-19T22:08:06.715552+0000","last_change":"2019-12-19T22:08:06.384407+0000","last_active":"2019-12-19T22:08:06.715552+0000","last_peered":"2019-12-19T22:08:06.715552+0000","last_clean":"2019-12-19T22:08:06.715552+0000","last_became_active":"2019-12-19T22:08:06.383871+0000","last_became_peered":"2019-12-19T22:08:06.383871+0000","last_unstale":"2019-12-19T22:08:06.715552+0000","last_undegraded":"2019-12-19T22:08:06.715552+0000","last_fullsized":"2019-12-19T22:08:06.715552+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_clean_scrub_stamp":"2019-12-19T22:08:05.371035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"9","reported_epoch":"16","state":"active+clean","last_fresh":"2019-12-19T22:08:06.717674+0000","last_change":"2019-12-19T22:08:06.717430+0000","last_active":"2019-12-19T22:08:06.717674+0000","last_peered":"2019-12-19T22:08:06.717674+0000","last_clean":"2019-12-19T22:08:06.717674+0000","last_became_active":"2019-12-19T22:08:06.717085+0000","last_became_peered":"2019-12-19T22:08:06.717085+0000","last_unstale":"2019-12-19T22:08:06.717674+0000","last_undegraded":"2019-12-19T22:08:06.717674+0000","last_fullsized":"2019-12-19T22:08:06.717674+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_clean_scrub_stamp":"2019-12-19T22:08:06.374096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"13","reported_epoch":"16","state":"active+clean","last_fresh":"2019-12-19T22:08:06.713955+0000","last_change":"2019-12-19T22:08:03.375817+0000","last_active":"2019-12-19T22:08:06.713955+0000","last_peered":"2019-12-19T22:08:06.713955+0000","last_clean":"2019-12-19T22:08:06.713955+0000","last_became_active":"2019-12-19T22:08:03.375549+0000","last_became_peered":"2019-12-19T22:08:03.375549+0000","last_unstale":"2019-12-19T22:08:06.713955+0000","last_undegraded":"2019-12-19T22:08:06.713955+0000","last_fullsized":"2019-12-19T22:08:06.713955+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_clean_scrub_stamp":"2019-12-19T22:08:02.364860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'5","reported_seq":"15","reported_epoch":"17","state":"active+clean","last_fresh":"2019-12-19T22:08:09.725614+0000","last_change":"2019-12-19T22:08:06.382991+0000","last_active":"2019-12-19T22:08:09.725614+0000","last_peered":"2019-12-19T22:08:09.725614+0000","last_clean":"2019-12-19T22:08:09.725614+0000","last_became_active":"2019-12-19T22:08:06.382299+0000","last_became_peered":"2019-12-19T22:08:06.382299+0000","last_unstale":"2019-12-19T22:08:09.725614+0000","last_undegraded":"2019-12-19T22:08:09.725614+0000","last_fullsized":"2019-12-19T22:08:09.725614+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_clean_scrub_stamp":"2019-12-19T22:08:05.371035+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"9","reported_epoch":"16","state":"active+clean","last_fresh":"2019-12-19T22:08:06.717389+0000","last_change":"2019-12-19T22:08:06.716759+0000","last_active":"2019-12-19T22:08:06.717389+0000","last_peered":"2019-12-19T22:08:06.717389+0000","last_clean":"2019-12-19T22:08:06.717389+0000","last_became_active":"2019-12-19T22:08:06.716445+0000","last_became_peered":"2019-12-19T22:08:06.716445+0000","last_unstale":"2019-12-19T22:08:06.717389+0000","last_undegraded":"2019-12-19T22:08:06.717389+0000","last_fullsized":"2019-12-19T22:08:06.717389+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_clean_scrub_stamp":"2019-12-19T22:08:06.374096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"12","reported_epoch":"16","state":"active+clean","last_fresh":"2019-12-19T22:08:06.715442+0000","last_change":"2019-12-19T22:08:03.374496+0000","last_active":"2019-12-19T22:08:06.715442+0000","last_peered":"2019-12-19T22:08:06.715442+0000","last_clean":"2019-12-19T22:08:06.715442+0000","last_became_active":"2019-12-19T22:08:03.373999+0000","last_became_peered":"2019-12-19T22:08:03.373999+0000","last_unstale":"2019-12-19T22:08:06.715442+0000","last_undegraded":"2019-12-19T22:08:06.715442+0000","last_fullsized":"2019-12-19T22:08:06.715442+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_clean_scrub_stamp":"2019-12-19T22:08:02.364860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"17'1","reported_seq":"11","reported_epoch":"17","state":"active+clean","last_fresh":"2019-12-19T22:08:08.271417+0000","last_change":"2019-12-19T22:08:06.383835+0000","last_active":"2019-12-19T22:08:08.271417+0000","last_peered":"2019-12-19T22:08:08.271417+0000","last_clean":"2019-12-19T22:08:08.271417+0000","last_became_active":"2019-12-19T22:08:06.383420+0000","last_became_peered":"2019-12-19T22:08:06.383420+0000","last_unstale":"2019-12-19T22:08:08.271417+0000","last_undegraded":"2019-12-19T22:08:08.271417+0000","last_fullsized":"2019-12-19T22:08:08.271417+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_clean_scrub_stamp":"2019-12-19T22:08:05.371035+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"9","reported_epoch":"16","state":"active+clean","last_fresh":"2019-12-19T22:08:06.717881+0000","last_change":"2019-12-19T22:08:06.717641+0000","last_active":"2019-12-19T22:08:06.717881+0000","last_peered":"2019-12-19T22:08:06.717881+0000","last_clean":"2019-12-19T22:08:06.717881+0000","last_became_active":"2019-12-19T22:08:06.717289+0000","last_became_peered":"2019-12-19T22:08:06.717289+0000","last_unstale":"2019-12-19T22:08:06.717881+0000","last_undegraded":"2019-12-19T22:08:06.717881+0000","last_fullsized":"2019-12-19T22:08:06.717881+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_clean_scrub_stamp":"2019-12-19T22:08:06.374096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"13","reported_epoch":"16","state":"active+clean","last_fresh":"2019-12-19T22:08:06.713577+0000","last_change":"2019-12-19T22:08:03.375588+0000","last_active":"2019-12-19T22:08:06.713577+0000","last_peered":"2019-12-19T22:08:06.713577+0000","last_clean":"2019-12-19T22:08:06.713577+0000","last_became_active":"2019-12-19T22:08:03.375236+0000","last_became_peered":"2019-12-19T22:08:03.375236+0000","last_unstale":"2019-12-19T22:08:06.713577+0000","last_undegraded":"2019-12-19T22:08:06.713577+0000","last_fullsized":"2019-12-19T22:08:06.713577+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_clean_scrub_stamp":"2019-12-19T22:08:02.364860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"17'6","reported_seq":"16","reported_epoch":"17","state":"active+clean","last_fresh":"2019-12-19T22:08:09.725171+0000","last_change":"2019-12-19T22:08:06.382924+0000","last_active":"2019-12-19T22:08:09.725171+0000","last_peered":"2019-12-19T22:08:09.725171+0000","last_clean":"2019-12-19T22:08:09.725171+0000","last_became_active":"2019-12-19T22:08:06.382181+0000","last_became_peered":"2019-12-19T22:08:06.382181+0000","last_unstale":"2019-12-19T22:08:09.725171+0000","last_undegraded":"2019-12-19T22:08:09.725171+0000","last_fullsized":"2019-12-19T22:08:09.725171+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_clean_scrub_stamp":"2019-12-19T22:08:05.371035+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"9","reported_epoch":"16","state":"active+clean","last_fresh":"2019-12-19T22:08:06.718689+0000","last_change":"2019-12-19T22:08:06.718506+0000","last_active":"2019-12-19T22:08:06.718689+0000","last_peered":"2019-12-19T22:08:06.718689+0000","last_clean":"2019-12-19T22:08:06.718689+0000","last_became_active":"2019-12-19T22:08:06.718242+0000","last_became_peered":"2019-12-19T22:08:06.718242+0000","last_unstale":"2019-12-19T22:08:06.718689+0000","last_undegraded":"2019-12-19T22:08:06.718689+0000","last_fullsized":"2019-12-19T22:08:06.718689+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_clean_scrub_stamp":"2019-12-19T22:08:06.374096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"13","reported_epoch":"16","state":"active+clean","last_fresh":"2019-12-19T22:08:06.714895+0000","last_change":"2019-12-19T22:08:03.373237+0000","last_active":"2019-12-19T22:08:06.714895+0000","last_peered":"2019-12-19T22:08:06.714895+0000","last_clean":"2019-12-19T22:08:06.714895+0000","last_became_active":"2019-12-19T22:08:03.372918+0000","last_became_peered":"2019-12-19T22:08:03.372918+0000","last_unstale":"2019-12-19T22:08:06.714895+0000","last_undegraded":"2019-12-19T22:08:06.714895+0000","last_fullsized":"2019-12-19T22:08:06.714895+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_clean_scrub_stamp":"2019-12-19T22:08:02.364860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"17'8","reported_seq":"18","reported_epoch":"17","state":"active+clean","last_fresh":"2019-12-19T22:08:09.727376+0000","last_change":"2019-12-19T22:08:06.385018+0000","last_active":"2019-12-19T22:08:09.727376+0000","last_peered":"2019-12-19T22:08:09.727376+0000","last_clean":"2019-12-19T22:08:09.727376+0000","last_became_active":"2019-12-19T22:08:06.384716+0000","last_became_peered":"2019-12-19T22:08:06.384716+0000","last_unstale":"2019-12-19T22:08:09.727376+0000","last_undegraded":"2019-12-19T22:08:09.727376+0000","last_fullsized":"2019-12-19T22:08:09.727376+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_clean_scrub_stamp":"2019-12-19T22:08:05.371035+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1526,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048760,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808840,"statfs":{"total":107374182400,"available":106300252160,"internally_reserved":1073741824,"allocated":180224,"data_stored":47162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.436}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.400}]}]},{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048732,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808868,"statfs":{"total":107374182400,"available":106300280832,"internally_reserved":1073741824,"allocated":151552,"data_stored":44910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.190}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.217}]}]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808844,"statfs":{"total":107374182400,"available":106300256256,"internally_reserved":1073741824,"allocated":176128,"data_stored":47128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.310}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.270}]}]}]}} 2019-12-19T22:08:14.073 INFO:tasks.ceph.ceph_manager.ceph:clean! 2019-12-19T22:08:14.074 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2019-12-19T22:08:14.074 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2019-12-19T22:08:14.074 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2019-12-19T22:08:14.189 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.184+0000 7f313a4af700 1 Processor -- start 2019-12-19T22:08:14.196 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.184+0000 7f313a4af700 1 -- start start 2019-12-19T22:08:14.197 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.185+0000 7f313a4af700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3134089480 0x7f31340898b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:14.197 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.185+0000 7f313a4af700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f313408edb0 con 0x7f313408f3d0 2019-12-19T22:08:14.197 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.185+0000 7f313a4af700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f313408ae60 con 0x7f3134089480 2019-12-19T22:08:14.197 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.185+0000 7f3138a4c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3134089480 0x7f31340898b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:14.197 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.185+0000 7f3133fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f313408f3d0 0x7f3134081170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39858/0 (socket says 172.21.15.50:39858) 2019-12-19T22:08:14.197 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.185+0000 7f3133fff700 1 -- 172.21.15.50:0/2451815006 learned_addr learned my addr 172.21.15.50:0/2451815006 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:14.198 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.185+0000 7f3138a4c700 1 -- 172.21.15.50:0/2451815006 >> v1:172.21.15.50:6789/0 conn(0x7f313408f3d0 legacy=0x7f3134081170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:14.198 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.185+0000 7f31337fe700 1 -- 172.21.15.50:0/2451815006 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2509510288 0 0) 0x7f313408edb0 con 0x7f313408f3d0 2019-12-19T22:08:14.198 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.185+0000 7f3138a4c700 1 -- 172.21.15.50:0/2451815006 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3134081970 con 0x7f3134089480 2019-12-19T22:08:14.198 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.185+0000 7f3138a4c700 1 --2- 172.21.15.50:0/2451815006 >> v2:172.21.15.50:3300/0 conn(0x7f3134089480 0x7f31340898b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3124008790 tx=0x7f312400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:14.198 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.185+0000 7f3138a4c700 1 --2- 172.21.15.50:0/2451815006 >> v2:172.21.15.50:3300/0 conn(0x7f3134089480 0x7f31340898b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3124008790 tx=0x7f312400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:14.198 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.185+0000 7f3138a4c700 1 --2- 172.21.15.50:0/2451815006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3134089480 0x7f31340898b0 secure :-1 s=READY pgs=163 cs=0 l=1 rx=0x7f3124008790 tx=0x7f312400fbf0).ready entity=mon.0 client_cookie=9062e0bed59913dc server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:14.198 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.186+0000 7f3138a4c700 1 --2- 172.21.15.50:0/2451815006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3134089480 0x7f31340898b0 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7f3124008790 tx=0x7f312400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:14.199 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.186+0000 7f31337fe700 1 -- 172.21.15.50:0/2451815006 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f3124011270 con 0x7f3134089480 2019-12-19T22:08:14.199 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.186+0000 7f3138a4c700 1 --2- 172.21.15.50:0/2451815006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3134089480 0x7f31340898b0 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7f3124008790 tx=0x7f312400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:14.199 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.186+0000 7f3138a4c700 1 --2- 172.21.15.50:0/2451815006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3134089480 0x7f31340898b0 secure :-1 s=THROTTLE_DONE pgs=163 cs=0 l=1 rx=0x7f3124008790 tx=0x7f312400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:14.199 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.186+0000 7f31337fe700 1 -- 172.21.15.50:0/2451815006 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3124011470 con 0x7f3134089480 2019-12-19T22:08:14.200 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.186+0000 7f31337fe700 1 -- 172.21.15.50:0/2451815006 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f3124011790 con 0x7f3134089480 2019-12-19T22:08:14.200 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.186+0000 7f313a4af700 1 -- 172.21.15.50:0/2451815006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3134089480 msgr2=0x7f31340898b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:14.200 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.186+0000 7f313a4af700 1 --2- 172.21.15.50:0/2451815006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3134089480 0x7f31340898b0 secure :-1 s=READY pgs=163 cs=0 l=1 rx=0x7f3124008790 tx=0x7f312400fbf0).stop 2019-12-19T22:08:14.200 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.186+0000 7f313a4af700 1 -- 172.21.15.50:0/2451815006 shutdown_connections 2019-12-19T22:08:14.200 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.186+0000 7f313a4af700 1 --2- 172.21.15.50:0/2451815006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3134089480 0x7f31340898b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:14.201 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.186+0000 7f313a4af700 1 -- 172.21.15.50:0/2451815006 shutdown_connections 2019-12-19T22:08:14.201 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.186+0000 7f313a4af700 1 -- 172.21.15.50:0/2451815006 wait complete. 2019-12-19T22:08:14.201 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.186+0000 7f313a4af700 1 -- 172.21.15.50:0/2451815006 >> 172.21.15.50:0/2451815006 conn(0x7f3134067e70 msgr2=0x7f3134094570 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:14.201 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.187+0000 7f313a4af700 1 Processor -- start 2019-12-19T22:08:14.201 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.187+0000 7f313a4af700 1 -- start start 2019-12-19T22:08:14.204 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.188+0000 7f313a4af700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f313407dfd0 0x7f3134062990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:14.204 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.188+0000 7f313a4af700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3134061c00 con 0x7f31340605a0 2019-12-19T22:08:14.204 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.188+0000 7f313a4af700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31340631e0 con 0x7f313407dfd0 2019-12-19T22:08:14.204 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.188+0000 7f3138a4c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f313407dfd0 0x7f3134062990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:14.204 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.188+0000 7f3138a4c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f313407dfd0 0x7f3134062990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53734/0 (socket says 172.21.15.50:53734) 2019-12-19T22:08:14.204 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.188+0000 7f3138a4c700 1 -- 172.21.15.50:0/4279447034 learned_addr learned my addr 172.21.15.50:0/4279447034 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:14.205 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.188+0000 7f3138a4c700 1 -- 172.21.15.50:0/4279447034 >> v1:172.21.15.50:6789/0 conn(0x7f31340605a0 legacy=0x7f31340609d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:14.205 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.188+0000 7f3138a4c700 1 -- 172.21.15.50:0/4279447034 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3134062ee0 con 0x7f313407dfd0 2019-12-19T22:08:14.205 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.188+0000 7f3138a4c700 1 --2- 172.21.15.50:0/4279447034 >> v2:172.21.15.50:3300/0 conn(0x7f313407dfd0 0x7f3134062990 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3124008790 tx=0x7f312400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:14.205 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.188+0000 7f3138a4c700 1 --2- 172.21.15.50:0/4279447034 >> v2:172.21.15.50:3300/0 conn(0x7f313407dfd0 0x7f3134062990 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3124008790 tx=0x7f312400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:14.205 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.188+0000 7f3138a4c700 1 --2- 172.21.15.50:0/4279447034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f313407dfd0 0x7f3134062990 secure :-1 s=READY pgs=165 cs=0 l=1 rx=0x7f3124008790 tx=0x7f312400f780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:14.205 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.188+0000 7f3138a4c700 1 --2- 172.21.15.50:0/4279447034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f313407dfd0 0x7f3134062990 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7f3124008790 tx=0x7f312400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:14.205 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.188+0000 7f3138a4c700 1 --2- 172.21.15.50:0/4279447034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f313407dfd0 0x7f3134062990 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7f3124008790 tx=0x7f312400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:14.206 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.188+0000 7f31317fa700 1 -- 172.21.15.50:0/4279447034 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f3124007280 con 0x7f313407dfd0 2019-12-19T22:08:14.206 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.188+0000 7f3138a4c700 1 --2- 172.21.15.50:0/4279447034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f313407dfd0 0x7f3134062990 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7f3124008790 tx=0x7f312400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:14.206 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.188+0000 7f31317fa700 1 -- 172.21.15.50:0/4279447034 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3124007480 con 0x7f313407dfd0 2019-12-19T22:08:14.206 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.188+0000 7f31317fa700 1 -- 172.21.15.50:0/4279447034 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f31240115b0 con 0x7f313407dfd0 2019-12-19T22:08:14.206 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.188+0000 7f313a4af700 1 -- 172.21.15.50:0/4279447034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3134061620 con 0x7f313407dfd0 2019-12-19T22:08:14.206 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.188+0000 7f313a4af700 1 -- 172.21.15.50:0/4279447034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31340611d0 con 0x7f313407dfd0 2019-12-19T22:08:14.206 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.189+0000 7f3138a4c700 1 --2- 172.21.15.50:0/4279447034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f313407dfd0 0x7f3134062990 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7f3124008790 tx=0x7f312400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:14.207 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.189+0000 7f31317fa700 1 -- 172.21.15.50:0/4279447034 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7f3124005540 con 0x7f313407dfd0 2019-12-19T22:08:14.207 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.189+0000 7f3138a4c700 1 --2- 172.21.15.50:0/4279447034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f313407dfd0 0x7f3134062990 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7f3124008790 tx=0x7f312400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:14.207 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.189+0000 7f31317fa700 1 --2- 172.21.15.50:0/4279447034 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f311401fab0 0x7f3114021fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:14.207 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.189+0000 7f31317fa700 1 -- 172.21.15.50:0/4279447034 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3403+0+0 (secure 0 0 0) 0x7f312402ada0 con 0x7f313407dfd0 2019-12-19T22:08:14.207 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.189+0000 7f3133fff700 1 --2- 172.21.15.50:0/4279447034 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f311401fab0 0x7f3114021fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:14.207 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.189+0000 7f313a4af700 1 -- 172.21.15.50:0/4279447034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3134056340 con 0x7f313407dfd0 2019-12-19T22:08:14.207 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.189+0000 7f3133fff700 1 --2- 172.21.15.50:0/4279447034 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f311401fab0 0x7f3114021fc0 crc :-1 s=READY pgs=40 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:14.208 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.193+0000 7f3138a4c700 1 --2- 172.21.15.50:0/4279447034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f313407dfd0 0x7f3134062990 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7f3124008790 tx=0x7f312400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:14.208 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.193+0000 7f31317fa700 1 -- 172.21.15.50:0/4279447034 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7f3124005d70 con 0x7f313407dfd0 2019-12-19T22:08:14.378 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.376+0000 7f313a4af700 1 -- 172.21.15.50:0/4279447034 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f313408dcf0 con 0x7f313407dfd0 2019-12-19T22:08:14.378 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.376+0000 7f3138a4c700 1 --2- 172.21.15.50:0/4279447034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f313407dfd0 0x7f3134062990 secure :-1 s=THROTTLE_DONE pgs=165 cs=0 l=1 rx=0x7f3124008790 tx=0x7f312400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:14.378 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.376+0000 7f31317fa700 1 -- 172.21.15.50:0/4279447034 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f3124005850 con 0x7f313407dfd0 2019-12-19T22:08:14.379 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:08:14.380 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.377+0000 7f313a4af700 1 -- 172.21.15.50:0/4279447034 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f311401fab0 msgr2=0x7f3114021fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:14.380 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.377+0000 7f313a4af700 1 --2- 172.21.15.50:0/4279447034 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f311401fab0 0x7f3114021fc0 crc :-1 s=READY pgs=40 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:14.380 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.377+0000 7f313a4af700 1 -- 172.21.15.50:0/4279447034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f313407dfd0 msgr2=0x7f3134062990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:14.380 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.377+0000 7f313a4af700 1 --2- 172.21.15.50:0/4279447034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f313407dfd0 0x7f3134062990 secure :-1 s=READY pgs=165 cs=0 l=1 rx=0x7f3124008790 tx=0x7f312400f780).stop 2019-12-19T22:08:14.380 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.377+0000 7f313a4af700 1 -- 172.21.15.50:0/4279447034 shutdown_connections 2019-12-19T22:08:14.380 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.377+0000 7f313a4af700 1 --2- 172.21.15.50:0/4279447034 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f311401fab0 0x7f3114021fc0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:14.381 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.377+0000 7f313a4af700 1 --2- 172.21.15.50:0/4279447034 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f313407dfd0 0x7f3134062990 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:14.381 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.377+0000 7f313a4af700 1 -- 172.21.15.50:0/4279447034 shutdown_connections 2019-12-19T22:08:14.381 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.377+0000 7f313a4af700 1 -- 172.21.15.50:0/4279447034 wait complete. 2019-12-19T22:08:14.381 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.377+0000 7f313a4af700 1 -- 172.21.15.50:0/4279447034 >> 172.21.15.50:0/4279447034 conn(0x7f3134081c40 msgr2=0x7f3134090040 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:14.390 INFO:teuthology.orchestra.run.smithi050.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2019-12-19T22:08:14.390 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2019-12-19T22:08:14.390 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-12-19T22:08:14.513 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.504+0000 7fe2bbb11700 1 Processor -- start 2019-12-19T22:08:14.513 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.504+0000 7fe2bbb11700 1 -- start start 2019-12-19T22:08:14.513 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.505+0000 7fe2bbb11700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe2b40898b0 0x7fe2b4081170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:14.514 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.505+0000 7fe2bbb11700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2b4089ce0 con 0x7fe2b4089480 2019-12-19T22:08:14.514 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.505+0000 7fe2bbb11700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2b408ae60 con 0x7fe2b40898b0 2019-12-19T22:08:14.514 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.505+0000 7fe2b98ad700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe2b40898b0 0x7fe2b4081170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:14.514 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.505+0000 7fe2ba0ae700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe2b4089480 0x7fe2b408f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39868/0 (socket says 172.21.15.50:39868) 2019-12-19T22:08:14.514 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.505+0000 7fe2ba0ae700 1 -- 172.21.15.50:0/2451400202 learned_addr learned my addr 172.21.15.50:0/2451400202 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:14.514 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.505+0000 7fe2b98ad700 1 -- 172.21.15.50:0/2451400202 >> v1:172.21.15.50:6789/0 conn(0x7fe2b4089480 legacy=0x7fe2b408f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:14.514 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.505+0000 7fe2b98ad700 1 -- 172.21.15.50:0/2451400202 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b408edb0 con 0x7fe2b40898b0 2019-12-19T22:08:14.515 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.505+0000 7fe2b98ad700 1 --2- 172.21.15.50:0/2451400202 >> v2:172.21.15.50:3300/0 conn(0x7fe2b40898b0 0x7fe2b4081170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe2a4008790 tx=0x7fe2a400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:14.515 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.505+0000 7fe2b98ad700 1 --2- 172.21.15.50:0/2451400202 >> v2:172.21.15.50:3300/0 conn(0x7fe2b40898b0 0x7fe2b4081170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe2a4008790 tx=0x7fe2a400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:14.515 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.505+0000 7fe2b98ad700 1 --2- 172.21.15.50:0/2451400202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2b40898b0 0x7fe2b4081170 secure :-1 s=READY pgs=167 cs=0 l=1 rx=0x7fe2a4008790 tx=0x7fe2a400fbf0).ready entity=mon.0 client_cookie=d52d8411e9c0ce5c server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:14.515 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.505+0000 7fe2b98ad700 1 --2- 172.21.15.50:0/2451400202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2b40898b0 0x7fe2b4081170 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7fe2a4008790 tx=0x7fe2a400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:14.515 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.505+0000 7fe2b90ac700 1 -- 172.21.15.50:0/2451400202 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fe2a4011270 con 0x7fe2b40898b0 2019-12-19T22:08:14.515 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.505+0000 7fe2b98ad700 1 --2- 172.21.15.50:0/2451400202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2b40898b0 0x7fe2b4081170 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7fe2a4008790 tx=0x7fe2a400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:14.515 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.506+0000 7fe2b90ac700 1 -- 172.21.15.50:0/2451400202 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a4011470 con 0x7fe2b40898b0 2019-12-19T22:08:14.516 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.506+0000 7fe2b98ad700 1 --2- 172.21.15.50:0/2451400202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2b40898b0 0x7fe2b4081170 secure :-1 s=THROTTLE_DONE pgs=167 cs=0 l=1 rx=0x7fe2a4008790 tx=0x7fe2a400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:14.516 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.506+0000 7fe2b90ac700 1 -- 172.21.15.50:0/2451400202 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fe2a40117d0 con 0x7fe2b40898b0 2019-12-19T22:08:14.516 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.506+0000 7fe2bbb11700 1 -- 172.21.15.50:0/2451400202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2b40898b0 msgr2=0x7fe2b4081170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:14.516 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.506+0000 7fe2bbb11700 1 --2- 172.21.15.50:0/2451400202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2b40898b0 0x7fe2b4081170 secure :-1 s=READY pgs=167 cs=0 l=1 rx=0x7fe2a4008790 tx=0x7fe2a400fbf0).stop 2019-12-19T22:08:14.524 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.506+0000 7fe2bbb11700 1 -- 172.21.15.50:0/2451400202 shutdown_connections 2019-12-19T22:08:14.524 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.506+0000 7fe2bbb11700 1 --2- 172.21.15.50:0/2451400202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2b40898b0 0x7fe2b4081170 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:14.524 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.506+0000 7fe2bbb11700 1 -- 172.21.15.50:0/2451400202 shutdown_connections 2019-12-19T22:08:14.526 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.506+0000 7fe2bbb11700 1 -- 172.21.15.50:0/2451400202 wait complete. 2019-12-19T22:08:14.526 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.506+0000 7fe2bbb11700 1 -- 172.21.15.50:0/2451400202 >> 172.21.15.50:0/2451400202 conn(0x7fe2b4067e70 msgr2=0x7fe2b4094570 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:14.526 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.507+0000 7fe2bbb11700 1 Processor -- start 2019-12-19T22:08:14.526 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.507+0000 7fe2bbb11700 1 -- start start 2019-12-19T22:08:14.526 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.507+0000 7fe2bbb11700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe2b41219e0 0x7fe2b4123e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:14.526 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.507+0000 7fe2bbb11700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2b40845c0 con 0x7fe2b40824d0 2019-12-19T22:08:14.527 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.507+0000 7fe2bbb11700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2b40892b0 con 0x7fe2b41219e0 2019-12-19T22:08:14.527 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.507+0000 7fe2ba0ae700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fe2b40824d0 0x7fe2b4082900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39872/0 (socket says 172.21.15.50:39872) 2019-12-19T22:08:14.527 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.507+0000 7fe2b98ad700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fe2b41219e0 0x7fe2b4123e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:14.527 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.507+0000 7fe2ba0ae700 1 -- 172.21.15.50:0/4043078266 learned_addr learned my addr 172.21.15.50:0/4043078266 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:14.527 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.508+0000 7fe2b98ad700 1 -- 172.21.15.50:0/4043078266 >> v1:172.21.15.50:6789/0 conn(0x7fe2b40824d0 legacy=0x7fe2b4082900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:14.527 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.508+0000 7fe2aaffd700 1 -- 172.21.15.50:0/4043078266 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1313813525 0 0) 0x7fe2b40845c0 con 0x7fe2b40824d0 2019-12-19T22:08:14.528 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.508+0000 7fe2b98ad700 1 -- 172.21.15.50:0/4043078266 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b4083db0 con 0x7fe2b41219e0 2019-12-19T22:08:14.528 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.508+0000 7fe2b98ad700 1 --2- 172.21.15.50:0/4043078266 >> v2:172.21.15.50:3300/0 conn(0x7fe2b41219e0 0x7fe2b4123e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe2a4008790 tx=0x7fe2a400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:14.528 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.508+0000 7fe2b98ad700 1 --2- 172.21.15.50:0/4043078266 >> v2:172.21.15.50:3300/0 conn(0x7fe2b41219e0 0x7fe2b4123e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe2a4008790 tx=0x7fe2a400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:14.528 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.508+0000 7fe2b98ad700 1 --2- 172.21.15.50:0/4043078266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2b41219e0 0x7fe2b4123e20 secure :-1 s=READY pgs=169 cs=0 l=1 rx=0x7fe2a4008790 tx=0x7fe2a400f780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:14.528 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.508+0000 7fe2b98ad700 1 --2- 172.21.15.50:0/4043078266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2b41219e0 0x7fe2b4123e20 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7fe2a4008790 tx=0x7fe2a400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:14.528 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.508+0000 7fe2aaffd700 1 -- 172.21.15.50:0/4043078266 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fe2a4007280 con 0x7fe2b41219e0 2019-12-19T22:08:14.528 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.508+0000 7fe2b98ad700 1 --2- 172.21.15.50:0/4043078266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2b41219e0 0x7fe2b4123e20 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7fe2a4008790 tx=0x7fe2a400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:14.529 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.508+0000 7fe2b98ad700 1 --2- 172.21.15.50:0/4043078266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2b41219e0 0x7fe2b4123e20 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7fe2a4008790 tx=0x7fe2a400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:14.529 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.508+0000 7fe2aaffd700 1 -- 172.21.15.50:0/4043078266 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a4007480 con 0x7fe2b41219e0 2019-12-19T22:08:14.529 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.508+0000 7fe2bbb11700 1 -- 172.21.15.50:0/4043078266 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2b4085d80 con 0x7fe2b41219e0 2019-12-19T22:08:14.529 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.508+0000 7fe2aaffd700 1 -- 172.21.15.50:0/4043078266 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fe2a40115b0 con 0x7fe2b41219e0 2019-12-19T22:08:14.529 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.508+0000 7fe2bbb11700 1 -- 172.21.15.50:0/4043078266 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2b4085440 con 0x7fe2b41219e0 2019-12-19T22:08:14.529 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.508+0000 7fe2b98ad700 1 --2- 172.21.15.50:0/4043078266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2b41219e0 0x7fe2b4123e20 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7fe2a4008790 tx=0x7fe2a400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:14.529 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.509+0000 7fe2aaffd700 1 -- 172.21.15.50:0/4043078266 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7fe2a4005540 con 0x7fe2b41219e0 2019-12-19T22:08:14.530 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.509+0000 7fe2b98ad700 1 --2- 172.21.15.50:0/4043078266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2b41219e0 0x7fe2b4123e20 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7fe2a4008790 tx=0x7fe2a400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:14.530 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.509+0000 7fe2aaffd700 1 --2- 172.21.15.50:0/4043078266 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fe29c01f9f0 0x7fe29c021f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:14.530 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.509+0000 7fe2aaffd700 1 -- 172.21.15.50:0/4043078266 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3403+0+0 (secure 0 0 0) 0x7fe2a402abc0 con 0x7fe2b41219e0 2019-12-19T22:08:14.530 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.509+0000 7fe2ba0ae700 1 --2- 172.21.15.50:0/4043078266 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fe29c01f9f0 0x7fe29c021f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:14.530 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.509+0000 7fe2ba0ae700 1 --2- 172.21.15.50:0/4043078266 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fe29c01f9f0 0x7fe29c021f00 crc :-1 s=READY pgs=41 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:14.531 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.509+0000 7fe2bbb11700 1 -- 172.21.15.50:0/4043078266 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2b4056340 con 0x7fe2b41219e0 2019-12-19T22:08:14.531 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.513+0000 7fe2b98ad700 1 --2- 172.21.15.50:0/4043078266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2b41219e0 0x7fe2b4123e20 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7fe2a4008790 tx=0x7fe2a400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:14.531 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.513+0000 7fe2aaffd700 1 -- 172.21.15.50:0/4043078266 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7fe2a400adc0 con 0x7fe2b41219e0 2019-12-19T22:08:14.653 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.650+0000 7fe2bbb11700 1 -- 172.21.15.50:0/4043078266 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2b4086060 con 0x7fe2b41219e0 2019-12-19T22:08:14.653 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.651+0000 7fe2b98ad700 1 --2- 172.21.15.50:0/4043078266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2b41219e0 0x7fe2b4123e20 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7fe2a4008790 tx=0x7fe2a400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:14.654 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.651+0000 7fe2aaffd700 1 -- 172.21.15.50:0/4043078266 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+8801 (secure 0 0 0) 0x7fe2a4011800 con 0x7fe2b41219e0 2019-12-19T22:08:14.654 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:08:14.654 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":17,"fsid":"c1382993-41cc-4b35-a402-c17778701f01","created":"2019-12-19T22:07:52.345475+0000","modified":"2019-12-19T22:08:07.711207+0000","last_up_change":"2019-12-19T22:07:58.357117+0000","last_in_change":"2019-12-19T22:07:58.357117+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-19T22:08:01.570202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2019-12-19T22:08:04.515784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2019-12-19T22:08:05.689151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6137ed8c-8e2c-4e88-8634-dc763bed14c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":27757},{"type":"v1","addr":"172.21.15.50:6817","nonce":27757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":27757},{"type":"v1","addr":"172.21.15.50:6819","nonce":27757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":27757},{"type":"v1","addr":"172.21.15.50:6823","nonce":27757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":27757},{"type":"v1","addr":"172.21.15.50:6821","nonce":27757}]},"public_addr":"172.21.15.50:6817/27757","cluster_addr":"172.21.15.50:6819/27757","heartbeat_back_addr":"172.21.15.50:6823/27757","heartbeat_front_addr":"172.21.15.50:6821/27757","state":["exists","up"]},{"osd":1,"uuid":"57d4e31d-408e-4302-859d-7ea672b93772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":27758},{"type":"v1","addr":"172.21.15.50:6801","nonce":27758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":27758},{"type":"v1","addr":"172.21.15.50:6803","nonce":27758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":27758},{"type":"v1","addr":"172.21.15.50:6810","nonce":27758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6805","nonce":27758},{"type":"v1","addr":"172.21.15.50:6807","nonce":27758}]},"public_addr":"172.21.15.50:6801/27758","cluster_addr":"172.21.15.50:6803/27758","heartbeat_back_addr":"172.21.15.50:6810/27758","heartbeat_front_addr":"172.21.15.50:6807/27758","state":["exists","up"]},{"osd":2,"uuid":"600ea585-aa50-4596-9b14-090eab15f9a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":27759},{"type":"v1","addr":"172.21.15.50:6806","nonce":27759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":27759},{"type":"v1","addr":"172.21.15.50:6811","nonce":27759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":27759},{"type":"v1","addr":"172.21.15.50:6816","nonce":27759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":27759},{"type":"v1","addr":"172.21.15.50:6813","nonce":27759}]},"public_addr":"172.21.15.50:6806/27759","cluster_addr":"172.21.15.50:6811/27759","heartbeat_back_addr":"172.21.15.50:6816/27759","heartbeat_front_addr":"172.21.15.50:6813/27759","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-19T22:07:56.415731+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-19T22:07:56.346062+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-19T22:07:56.090889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-19T22:08:14.656 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.652+0000 7fe2bbb11700 1 -- 172.21.15.50:0/4043078266 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fe29c01f9f0 msgr2=0x7fe29c021f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:14.656 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.652+0000 7fe2bbb11700 1 --2- 172.21.15.50:0/4043078266 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fe29c01f9f0 0x7fe29c021f00 crc :-1 s=READY pgs=41 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:14.656 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.652+0000 7fe2bbb11700 1 -- 172.21.15.50:0/4043078266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2b41219e0 msgr2=0x7fe2b4123e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:14.656 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.652+0000 7fe2bbb11700 1 --2- 172.21.15.50:0/4043078266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2b41219e0 0x7fe2b4123e20 secure :-1 s=READY pgs=169 cs=0 l=1 rx=0x7fe2a4008790 tx=0x7fe2a400f780).stop 2019-12-19T22:08:14.657 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.652+0000 7fe2bbb11700 1 -- 172.21.15.50:0/4043078266 shutdown_connections 2019-12-19T22:08:14.657 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.652+0000 7fe2bbb11700 1 --2- 172.21.15.50:0/4043078266 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fe29c01f9f0 0x7fe29c021f00 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:14.657 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.652+0000 7fe2bbb11700 1 --2- 172.21.15.50:0/4043078266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2b41219e0 0x7fe2b4123e20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:14.657 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.652+0000 7fe2bbb11700 1 -- 172.21.15.50:0/4043078266 shutdown_connections 2019-12-19T22:08:14.657 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.652+0000 7fe2bbb11700 1 -- 172.21.15.50:0/4043078266 wait complete. 2019-12-19T22:08:14.657 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.652+0000 7fe2bbb11700 1 -- 172.21.15.50:0/4043078266 >> 172.21.15.50:0/4043078266 conn(0x7fe2b4091150 msgr2=0x7fe2b407ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:14.669 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-19T22:08:01.570202+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'13', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-19T22:08:04.515784+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'16', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-19T22:08:05.689151+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-12-19T22:08:14.670 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-12-19T22:08:14.793 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.785+0000 7f5ebbfe8700 1 Processor -- start 2019-12-19T22:08:14.793 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.785+0000 7f5ebbfe8700 1 -- start start 2019-12-19T22:08:14.793 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.785+0000 7f5ebbfe8700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5eb407dac0 0x7f5eb408eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:14.793 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.785+0000 7f5ebbfe8700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eb408fd30 con 0x7f5eb4089510 2019-12-19T22:08:14.793 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.785+0000 7f5ebbfe8700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eb408f8f0 con 0x7f5eb407dac0 2019-12-19T22:08:14.793 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.785+0000 7f5eba585700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5eb407dac0 0x7f5eb408eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:14.794 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.785+0000 7f5eba585700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5eb407dac0 0x7f5eb408eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53750/0 (socket says 172.21.15.50:53750) 2019-12-19T22:08:14.794 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.786+0000 7f5eba585700 1 -- 172.21.15.50:0/423125856 learned_addr learned my addr 172.21.15.50:0/423125856 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:14.794 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.786+0000 7f5eba585700 1 -- 172.21.15.50:0/423125856 >> v1:172.21.15.50:6789/0 conn(0x7f5eb4089510 legacy=0x7f5eb407e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:14.794 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.786+0000 7f5eba585700 1 -- 172.21.15.50:0/423125856 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb408de50 con 0x7f5eb407dac0 2019-12-19T22:08:14.795 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.786+0000 7f5eba585700 1 --2- 172.21.15.50:0/423125856 >> v2:172.21.15.50:3300/0 conn(0x7f5eb407dac0 0x7f5eb408eb70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5eac008b10 tx=0x7f5eac010030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:14.798 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.786+0000 7f5eba585700 1 --2- 172.21.15.50:0/423125856 >> v2:172.21.15.50:3300/0 conn(0x7f5eb407dac0 0x7f5eb408eb70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5eac008b10 tx=0x7f5eac010030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:14.798 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.786+0000 7f5eba585700 1 --2- 172.21.15.50:0/423125856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5eb407dac0 0x7f5eb408eb70 secure :-1 s=READY pgs=171 cs=0 l=1 rx=0x7f5eac008b10 tx=0x7f5eac010030).ready entity=mon.0 client_cookie=5e8123ef66b95944 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:14.798 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.786+0000 7f5eba585700 1 --2- 172.21.15.50:0/423125856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5eb407dac0 0x7f5eb408eb70 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7f5eac008b10 tx=0x7f5eac010030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:14.798 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.786+0000 7f5eb9583700 1 -- 172.21.15.50:0/423125856 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f5eac011cc0 con 0x7f5eb407dac0 2019-12-19T22:08:14.798 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.786+0000 7f5eba585700 1 --2- 172.21.15.50:0/423125856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5eb407dac0 0x7f5eb408eb70 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7f5eac008b10 tx=0x7f5eac010030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:14.798 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.786+0000 7f5eba585700 1 --2- 172.21.15.50:0/423125856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5eb407dac0 0x7f5eb408eb70 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7f5eac008b10 tx=0x7f5eac010030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:14.798 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.786+0000 7f5eb9583700 1 -- 172.21.15.50:0/423125856 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eac00a160 con 0x7f5eb407dac0 2019-12-19T22:08:14.799 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.786+0000 7f5eb9583700 1 -- 172.21.15.50:0/423125856 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f5eac00a480 con 0x7f5eb407dac0 2019-12-19T22:08:14.799 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.786+0000 7f5ebbfe8700 1 -- 172.21.15.50:0/423125856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5eb407dac0 msgr2=0x7f5eb408eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:14.799 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.786+0000 7f5ebbfe8700 1 --2- 172.21.15.50:0/423125856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5eb407dac0 0x7f5eb408eb70 secure :-1 s=READY pgs=171 cs=0 l=1 rx=0x7f5eac008b10 tx=0x7f5eac010030).stop 2019-12-19T22:08:14.799 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.786+0000 7f5ebbfe8700 1 -- 172.21.15.50:0/423125856 shutdown_connections 2019-12-19T22:08:14.799 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.786+0000 7f5ebbfe8700 1 --2- 172.21.15.50:0/423125856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5eb407dac0 0x7f5eb408eb70 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:14.799 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.787+0000 7f5ebbfe8700 1 -- 172.21.15.50:0/423125856 shutdown_connections 2019-12-19T22:08:14.799 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.787+0000 7f5ebbfe8700 1 -- 172.21.15.50:0/423125856 wait complete. 2019-12-19T22:08:14.800 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.787+0000 7f5ebbfe8700 1 -- 172.21.15.50:0/423125856 >> 172.21.15.50:0/423125856 conn(0x7f5eb4092f20 msgr2=0x7f5eb408b240 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:14.800 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.787+0000 7f5ebbfe8700 1 Processor -- start 2019-12-19T22:08:14.800 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.788+0000 7f5ebbfe8700 1 -- start start 2019-12-19T22:08:14.800 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.788+0000 7f5ebbfe8700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5eb4089960 0x7f5eb4065130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:14.800 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.788+0000 7f5ebbfe8700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eb4064040 con 0x7f5eb4089530 2019-12-19T22:08:14.800 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.788+0000 7f5ebbfe8700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eb4062db0 con 0x7f5eb4089960 2019-12-19T22:08:14.800 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.788+0000 7f5eb9d84700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5eb4089960 0x7f5eb4065130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:14.801 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.788+0000 7f5eba585700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5eb4089530 0x7f5eb4064930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39882/0 (socket says 172.21.15.50:39882) 2019-12-19T22:08:14.801 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.788+0000 7f5eba585700 1 -- 172.21.15.50:0/468789884 learned_addr learned my addr 172.21.15.50:0/468789884 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:14.801 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.788+0000 7f5eb9d84700 1 -- 172.21.15.50:0/468789884 >> v1:172.21.15.50:6789/0 conn(0x7f5eb4089530 legacy=0x7f5eb4064930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:14.801 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.788+0000 7f5eb9d84700 1 -- 172.21.15.50:0/468789884 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb4065680 con 0x7f5eb4089960 2019-12-19T22:08:14.801 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.788+0000 7f5eb2ffd700 1 -- 172.21.15.50:0/468789884 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2697821859 0 0) 0x7f5eb4064040 con 0x7f5eb4089530 2019-12-19T22:08:14.801 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.788+0000 7f5eb9d84700 1 --2- 172.21.15.50:0/468789884 >> v2:172.21.15.50:3300/0 conn(0x7f5eb4089960 0x7f5eb4065130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5ea8000e90 tx=0x7f5ea800c2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:14.801 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.788+0000 7f5eb9d84700 1 --2- 172.21.15.50:0/468789884 >> v2:172.21.15.50:3300/0 conn(0x7f5eb4089960 0x7f5eb4065130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5ea8000e90 tx=0x7f5ea800c2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:14.802 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.788+0000 7f5eb9d84700 1 --2- 172.21.15.50:0/468789884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5eb4089960 0x7f5eb4065130 secure :-1 s=READY pgs=173 cs=0 l=1 rx=0x7f5ea8000e90 tx=0x7f5ea800c2f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:14.802 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.789+0000 7f5eb9d84700 1 --2- 172.21.15.50:0/468789884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5eb4089960 0x7f5eb4065130 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7f5ea8000e90 tx=0x7f5ea800c2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:14.802 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.789+0000 7f5eb2ffd700 1 -- 172.21.15.50:0/468789884 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f5ea800ca10 con 0x7f5eb4089960 2019-12-19T22:08:14.802 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.789+0000 7f5eb9d84700 1 --2- 172.21.15.50:0/468789884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5eb4089960 0x7f5eb4065130 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7f5ea8000e90 tx=0x7f5ea800c2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:14.802 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.789+0000 7f5eb9d84700 1 --2- 172.21.15.50:0/468789884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5eb4089960 0x7f5eb4065130 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7f5ea8000e90 tx=0x7f5ea800c2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:14.802 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.789+0000 7f5eb2ffd700 1 -- 172.21.15.50:0/468789884 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea800cc10 con 0x7f5eb4089960 2019-12-19T22:08:14.802 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.789+0000 7f5ebbfe8700 1 -- 172.21.15.50:0/468789884 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eb4063130 con 0x7f5eb4089960 2019-12-19T22:08:14.805 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.789+0000 7f5eb2ffd700 1 -- 172.21.15.50:0/468789884 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f5ea8010e40 con 0x7f5eb4089960 2019-12-19T22:08:14.805 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.789+0000 7f5ebbfe8700 1 -- 172.21.15.50:0/468789884 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eb4061f50 con 0x7f5eb4089960 2019-12-19T22:08:14.805 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.789+0000 7f5eb9d84700 1 --2- 172.21.15.50:0/468789884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5eb4089960 0x7f5eb4065130 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7f5ea8000e90 tx=0x7f5ea800c2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:14.806 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.789+0000 7f5eb2ffd700 1 -- 172.21.15.50:0/468789884 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7f5ea8007430 con 0x7f5eb4089960 2019-12-19T22:08:14.806 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.789+0000 7f5eb9d84700 1 --2- 172.21.15.50:0/468789884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5eb4089960 0x7f5eb4065130 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7f5ea8000e90 tx=0x7f5ea800c2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:14.806 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.789+0000 7f5eb2ffd700 1 --2- 172.21.15.50:0/468789884 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f5e9401f990 0x7f5e94021ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:14.806 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.789+0000 7f5eb2ffd700 1 -- 172.21.15.50:0/468789884 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3403+0+0 (secure 0 0 0) 0x7f5ea802a4d0 con 0x7f5eb4089960 2019-12-19T22:08:14.806 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.789+0000 7f5eba585700 1 --2- 172.21.15.50:0/468789884 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f5e9401f990 0x7f5e94021ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:14.806 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.790+0000 7f5eba585700 1 --2- 172.21.15.50:0/468789884 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f5e9401f990 0x7f5e94021ea0 crc :-1 s=READY pgs=42 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:14.806 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.790+0000 7f5ebbfe8700 1 -- 172.21.15.50:0/468789884 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eb4056340 con 0x7f5eb4089960 2019-12-19T22:08:14.807 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.793+0000 7f5eb9d84700 1 --2- 172.21.15.50:0/468789884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5eb4089960 0x7f5eb4065130 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7f5ea8000e90 tx=0x7f5ea800c2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:14.807 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.793+0000 7f5eb2ffd700 1 -- 172.21.15.50:0/468789884 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7f5ea8007740 con 0x7f5eb4089960 2019-12-19T22:08:14.932 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.930+0000 7f5ebbfe8700 1 -- 172.21.15.50:0/468789884 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5eb4095360 con 0x7f5eb4089960 2019-12-19T22:08:14.932 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.930+0000 7f5eb9d84700 1 --2- 172.21.15.50:0/468789884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5eb4089960 0x7f5eb4065130 secure :-1 s=THROTTLE_DONE pgs=173 cs=0 l=1 rx=0x7f5ea8000e90 tx=0x7f5ea800c2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:14.933 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.930+0000 7f5eb2ffd700 1 -- 172.21.15.50:0/468789884 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5ea8029fb0 con 0x7f5eb4089960 2019-12-19T22:08:14.933 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2019-12-19T22:08:14.934 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.931+0000 7f5ebbfe8700 1 -- 172.21.15.50:0/468789884 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f5e9401f990 msgr2=0x7f5e94021ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:14.934 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.931+0000 7f5ebbfe8700 1 --2- 172.21.15.50:0/468789884 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f5e9401f990 0x7f5e94021ea0 crc :-1 s=READY pgs=42 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:14.934 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.931+0000 7f5ebbfe8700 1 -- 172.21.15.50:0/468789884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5eb4089960 msgr2=0x7f5eb4065130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:14.934 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.931+0000 7f5ebbfe8700 1 --2- 172.21.15.50:0/468789884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5eb4089960 0x7f5eb4065130 secure :-1 s=READY pgs=173 cs=0 l=1 rx=0x7f5ea8000e90 tx=0x7f5ea800c2f0).stop 2019-12-19T22:08:14.934 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.931+0000 7f5ebbfe8700 1 -- 172.21.15.50:0/468789884 shutdown_connections 2019-12-19T22:08:14.935 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.931+0000 7f5ebbfe8700 1 --2- 172.21.15.50:0/468789884 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f5e9401f990 0x7f5e94021ea0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:14.935 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.931+0000 7f5ebbfe8700 1 --2- 172.21.15.50:0/468789884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5eb4089960 0x7f5eb4065130 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:14.935 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.931+0000 7f5ebbfe8700 1 -- 172.21.15.50:0/468789884 shutdown_connections 2019-12-19T22:08:14.935 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.931+0000 7f5ebbfe8700 1 -- 172.21.15.50:0/468789884 wait complete. 2019-12-19T22:08:14.935 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:14.931+0000 7f5ebbfe8700 1 -- 172.21.15.50:0/468789884 >> 172.21.15.50:0/468789884 conn(0x7f5eb4090040 msgr2=0x7f5eb4092f20 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:14.945 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-12-19T22:08:15.064 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.059+0000 7f6e53663700 1 Processor -- start 2019-12-19T22:08:15.065 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.059+0000 7f6e53663700 1 -- start start 2019-12-19T22:08:15.065 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.060+0000 7f6e53663700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6e4c07dac0 0x7f6e4c08eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:15.065 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.060+0000 7f6e53663700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e4c08fd30 con 0x7f6e4c089510 2019-12-19T22:08:15.065 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.060+0000 7f6e53663700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e4c08f8f0 con 0x7f6e4c07dac0 2019-12-19T22:08:15.065 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.060+0000 7f6e51c00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6e4c07dac0 0x7f6e4c08eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:15.065 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.060+0000 7f6e513ff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6e4c089510 0x7f6e4c07e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39888/0 (socket says 172.21.15.50:39888) 2019-12-19T22:08:15.066 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.060+0000 7f6e51c00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6e4c07dac0 0x7f6e4c08eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53760/0 (socket says 172.21.15.50:53760) 2019-12-19T22:08:15.066 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.060+0000 7f6e513ff700 1 -- 172.21.15.50:0/328256884 learned_addr learned my addr 172.21.15.50:0/328256884 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:15.066 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.060+0000 7f6e51c00700 1 -- 172.21.15.50:0/328256884 >> v1:172.21.15.50:6789/0 conn(0x7f6e4c089510 legacy=0x7f6e4c07e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:15.066 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.060+0000 7f6e50bfe700 1 -- 172.21.15.50:0/328256884 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1078889068 0 0) 0x7f6e4c08fd30 con 0x7f6e4c089510 2019-12-19T22:08:15.066 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.060+0000 7f6e51c00700 1 -- 172.21.15.50:0/328256884 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e4c08de50 con 0x7f6e4c07dac0 2019-12-19T22:08:15.066 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.060+0000 7f6e51c00700 1 --2- 172.21.15.50:0/328256884 >> v2:172.21.15.50:3300/0 conn(0x7f6e4c07dac0 0x7f6e4c08eb70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6e48008790 tx=0x7f6e4800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:15.066 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.060+0000 7f6e51c00700 1 --2- 172.21.15.50:0/328256884 >> v2:172.21.15.50:3300/0 conn(0x7f6e4c07dac0 0x7f6e4c08eb70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6e48008790 tx=0x7f6e4800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:15.067 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.060+0000 7f6e51c00700 1 --2- 172.21.15.50:0/328256884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e4c07dac0 0x7f6e4c08eb70 secure :-1 s=READY pgs=175 cs=0 l=1 rx=0x7f6e48008790 tx=0x7f6e4800fbf0).ready entity=mon.0 client_cookie=7f886ee4ae310842 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:15.067 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.061+0000 7f6e51c00700 1 --2- 172.21.15.50:0/328256884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e4c07dac0 0x7f6e4c08eb70 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f6e48008790 tx=0x7f6e4800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:15.067 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.061+0000 7f6e50bfe700 1 -- 172.21.15.50:0/328256884 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f6e48011230 con 0x7f6e4c07dac0 2019-12-19T22:08:15.067 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.061+0000 7f6e51c00700 1 --2- 172.21.15.50:0/328256884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e4c07dac0 0x7f6e4c08eb70 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f6e48008790 tx=0x7f6e4800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:15.067 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.061+0000 7f6e50bfe700 1 -- 172.21.15.50:0/328256884 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e48011430 con 0x7f6e4c07dac0 2019-12-19T22:08:15.069 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.061+0000 7f6e51c00700 1 --2- 172.21.15.50:0/328256884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e4c07dac0 0x7f6e4c08eb70 secure :-1 s=THROTTLE_DONE pgs=175 cs=0 l=1 rx=0x7f6e48008790 tx=0x7f6e4800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:15.069 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.061+0000 7f6e53663700 1 -- 172.21.15.50:0/328256884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e4c07dac0 msgr2=0x7f6e4c08eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:15.069 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.061+0000 7f6e50bfe700 1 -- 172.21.15.50:0/328256884 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f6e48011750 con 0x7f6e4c07dac0 2019-12-19T22:08:15.069 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.061+0000 7f6e53663700 1 --2- 172.21.15.50:0/328256884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e4c07dac0 0x7f6e4c08eb70 secure :-1 s=READY pgs=175 cs=0 l=1 rx=0x7f6e48008790 tx=0x7f6e4800fbf0).stop 2019-12-19T22:08:15.069 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.061+0000 7f6e53663700 1 -- 172.21.15.50:0/328256884 shutdown_connections 2019-12-19T22:08:15.069 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.061+0000 7f6e53663700 1 --2- 172.21.15.50:0/328256884 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e4c07dac0 0x7f6e4c08eb70 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:15.070 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.061+0000 7f6e53663700 1 -- 172.21.15.50:0/328256884 shutdown_connections 2019-12-19T22:08:15.070 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.061+0000 7f6e53663700 1 -- 172.21.15.50:0/328256884 wait complete. 2019-12-19T22:08:15.070 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.061+0000 7f6e53663700 1 -- 172.21.15.50:0/328256884 >> 172.21.15.50:0/328256884 conn(0x7f6e4c092f20 msgr2=0x7f6e4c08b240 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:15.070 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.062+0000 7f6e53663700 1 Processor -- start 2019-12-19T22:08:15.070 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.062+0000 7f6e53663700 1 -- start start 2019-12-19T22:08:15.076 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.063+0000 7f6e53663700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6e4c089740 0x7f6e4c0649d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:15.083 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.063+0000 7f6e53663700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e4c0634d0 con 0x7f6e4c089b70 2019-12-19T22:08:15.083 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.063+0000 7f6e53663700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e4c07ecd0 con 0x7f6e4c089740 2019-12-19T22:08:15.084 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.063+0000 7f6e51c00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6e4c089740 0x7f6e4c0649d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:15.084 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.063+0000 7f6e51c00700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6e4c089740 0x7f6e4c0649d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53764/0 (socket says 172.21.15.50:53764) 2019-12-19T22:08:15.084 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.063+0000 7f6e51c00700 1 -- 172.21.15.50:0/40980726 learned_addr learned my addr 172.21.15.50:0/40980726 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:15.084 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.063+0000 7f6e51c00700 1 -- 172.21.15.50:0/40980726 >> v1:172.21.15.50:6789/0 conn(0x7f6e4c089b70 legacy=0x7f6e4c064f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:15.084 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.063+0000 7f6e51c00700 1 -- 172.21.15.50:0/40980726 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e4c062e50 con 0x7f6e4c089740 2019-12-19T22:08:15.084 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.063+0000 7f6e51c00700 1 --2- 172.21.15.50:0/40980726 >> v2:172.21.15.50:3300/0 conn(0x7f6e4c089740 0x7f6e4c0649d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6e48008790 tx=0x7f6e48011c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:15.085 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.063+0000 7f6e51c00700 1 --2- 172.21.15.50:0/40980726 >> v2:172.21.15.50:3300/0 conn(0x7f6e4c089740 0x7f6e4c0649d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6e48008790 tx=0x7f6e48011c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:15.085 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.063+0000 7f6e51c00700 1 --2- 172.21.15.50:0/40980726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e4c089740 0x7f6e4c0649d0 secure :-1 s=READY pgs=177 cs=0 l=1 rx=0x7f6e48008790 tx=0x7f6e48011c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:15.085 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.063+0000 7f6e51c00700 1 --2- 172.21.15.50:0/40980726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e4c089740 0x7f6e4c0649d0 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f6e48008790 tx=0x7f6e48011c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:15.085 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.063+0000 7f6e427fc700 1 -- 172.21.15.50:0/40980726 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f6e48007280 con 0x7f6e4c089740 2019-12-19T22:08:15.085 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.063+0000 7f6e51c00700 1 --2- 172.21.15.50:0/40980726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e4c089740 0x7f6e4c0649d0 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f6e48008790 tx=0x7f6e48011c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:15.085 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.063+0000 7f6e51c00700 1 --2- 172.21.15.50:0/40980726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e4c089740 0x7f6e4c0649d0 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f6e48008790 tx=0x7f6e48011c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:15.085 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.063+0000 7f6e427fc700 1 -- 172.21.15.50:0/40980726 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e48011440 con 0x7f6e4c089740 2019-12-19T22:08:15.087 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.063+0000 7f6e53663700 1 -- 172.21.15.50:0/40980726 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e4c0646c0 con 0x7f6e4c089740 2019-12-19T22:08:15.087 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.063+0000 7f6e427fc700 1 -- 172.21.15.50:0/40980726 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f6e48005540 con 0x7f6e4c089740 2019-12-19T22:08:15.087 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.063+0000 7f6e53663700 1 -- 172.21.15.50:0/40980726 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e4c062010 con 0x7f6e4c089740 2019-12-19T22:08:15.087 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.064+0000 7f6e51c00700 1 --2- 172.21.15.50:0/40980726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e4c089740 0x7f6e4c0649d0 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f6e48008790 tx=0x7f6e48011c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:15.088 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.064+0000 7f6e427fc700 1 -- 172.21.15.50:0/40980726 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7f6e48005790 con 0x7f6e4c089740 2019-12-19T22:08:15.088 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.064+0000 7f6e51c00700 1 --2- 172.21.15.50:0/40980726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e4c089740 0x7f6e4c0649d0 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f6e48008790 tx=0x7f6e48011c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:15.088 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.064+0000 7f6e427fc700 1 --2- 172.21.15.50:0/40980726 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f6e3401fa60 0x7f6e34021f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:15.088 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.064+0000 7f6e427fc700 1 -- 172.21.15.50:0/40980726 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3403+0+0 (secure 0 0 0) 0x7f6e4802ad70 con 0x7f6e4c089740 2019-12-19T22:08:15.088 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.064+0000 7f6e513ff700 1 --2- 172.21.15.50:0/40980726 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f6e3401fa60 0x7f6e34021f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:15.088 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.064+0000 7f6e513ff700 1 --2- 172.21.15.50:0/40980726 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f6e3401fa60 0x7f6e34021f70 crc :-1 s=READY pgs=43 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:15.088 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.064+0000 7f6e53663700 1 -- 172.21.15.50:0/40980726 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e4c056340 con 0x7f6e4c089740 2019-12-19T22:08:15.089 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.068+0000 7f6e51c00700 1 --2- 172.21.15.50:0/40980726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e4c089740 0x7f6e4c0649d0 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f6e48008790 tx=0x7f6e48011c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:15.089 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.068+0000 7f6e427fc700 1 -- 172.21.15.50:0/40980726 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7f6e4c062e50 con 0x7f6e4c089740 2019-12-19T22:08:15.207 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.204+0000 7f6e53663700 1 -- 172.21.15.50:0/40980726 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6e4c07da30 con 0x7f6e4c089740 2019-12-19T22:08:15.207 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.205+0000 7f6e51c00700 1 --2- 172.21.15.50:0/40980726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e4c089740 0x7f6e4c0649d0 secure :-1 s=THROTTLE_DONE pgs=177 cs=0 l=1 rx=0x7f6e48008790 tx=0x7f6e48011c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:15.207 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.205+0000 7f6e427fc700 1 -- 172.21.15.50:0/40980726 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v17) v1 ==== 104+0+10 (secure 0 0 0) 0x7f6e4800d400 con 0x7f6e4c089740 2019-12-19T22:08:15.208 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2019-12-19T22:08:15.209 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.206+0000 7f6e53663700 1 -- 172.21.15.50:0/40980726 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f6e3401fa60 msgr2=0x7f6e34021f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:15.209 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.206+0000 7f6e53663700 1 --2- 172.21.15.50:0/40980726 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f6e3401fa60 0x7f6e34021f70 crc :-1 s=READY pgs=43 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:15.209 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.206+0000 7f6e53663700 1 -- 172.21.15.50:0/40980726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e4c089740 msgr2=0x7f6e4c0649d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:15.209 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.206+0000 7f6e53663700 1 --2- 172.21.15.50:0/40980726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e4c089740 0x7f6e4c0649d0 secure :-1 s=READY pgs=177 cs=0 l=1 rx=0x7f6e48008790 tx=0x7f6e48011c80).stop 2019-12-19T22:08:15.209 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.206+0000 7f6e53663700 1 -- 172.21.15.50:0/40980726 shutdown_connections 2019-12-19T22:08:15.209 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.206+0000 7f6e53663700 1 --2- 172.21.15.50:0/40980726 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f6e3401fa60 0x7f6e34021f70 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:15.209 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.206+0000 7f6e53663700 1 --2- 172.21.15.50:0/40980726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6e4c089740 0x7f6e4c0649d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:15.210 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.206+0000 7f6e53663700 1 -- 172.21.15.50:0/40980726 shutdown_connections 2019-12-19T22:08:15.210 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.206+0000 7f6e53663700 1 -- 172.21.15.50:0/40980726 wait complete. 2019-12-19T22:08:15.210 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.206+0000 7f6e53663700 1 -- 172.21.15.50:0/40980726 >> 172.21.15.50:0/40980726 conn(0x7f6e4c08d6e0 msgr2=0x7f6e4c092f20 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:15.219 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-12-19T22:08:15.342 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.332+0000 7f0e4b931700 1 Processor -- start 2019-12-19T22:08:15.342 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.333+0000 7f0e4b931700 1 -- start start 2019-12-19T22:08:15.343 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.333+0000 7f0e4b931700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0e4407dac0 0x7f0e4408eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:15.343 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.333+0000 7f0e4b931700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e4408fd30 con 0x7f0e44089510 2019-12-19T22:08:15.343 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.333+0000 7f0e4b931700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e4408f8f0 con 0x7f0e4407dac0 2019-12-19T22:08:15.343 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.333+0000 7f0e49ece700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0e4407dac0 0x7f0e4408eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:15.343 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.333+0000 7f0e496cd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f0e44089510 0x7f0e4407e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39898/0 (socket says 172.21.15.50:39898) 2019-12-19T22:08:15.343 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.333+0000 7f0e496cd700 1 -- 172.21.15.50:0/3388046879 learned_addr learned my addr 172.21.15.50:0/3388046879 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:15.344 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.333+0000 7f0e49ece700 1 -- 172.21.15.50:0/3388046879 >> v1:172.21.15.50:6789/0 conn(0x7f0e44089510 legacy=0x7f0e4407e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:15.344 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.334+0000 7f0e48ecc700 1 -- 172.21.15.50:0/3388046879 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 64837981 0 0) 0x7f0e4408fd30 con 0x7f0e44089510 2019-12-19T22:08:15.344 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.334+0000 7f0e49ece700 1 -- 172.21.15.50:0/3388046879 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e4408de50 con 0x7f0e4407dac0 2019-12-19T22:08:15.344 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.334+0000 7f0e49ece700 1 --2- 172.21.15.50:0/3388046879 >> v2:172.21.15.50:3300/0 conn(0x7f0e4407dac0 0x7f0e4408eb70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0e40008790 tx=0x7f0e4000fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:15.345 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.334+0000 7f0e49ece700 1 --2- 172.21.15.50:0/3388046879 >> v2:172.21.15.50:3300/0 conn(0x7f0e4407dac0 0x7f0e4408eb70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0e40008790 tx=0x7f0e4000fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:15.345 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.334+0000 7f0e49ece700 1 --2- 172.21.15.50:0/3388046879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e4407dac0 0x7f0e4408eb70 secure :-1 s=READY pgs=179 cs=0 l=1 rx=0x7f0e40008790 tx=0x7f0e4000fbf0).ready entity=mon.0 client_cookie=9e684489a538dbec server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:15.345 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.334+0000 7f0e49ece700 1 --2- 172.21.15.50:0/3388046879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e4407dac0 0x7f0e4408eb70 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f0e40008790 tx=0x7f0e4000fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:15.345 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.334+0000 7f0e48ecc700 1 -- 172.21.15.50:0/3388046879 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f0e40011230 con 0x7f0e4407dac0 2019-12-19T22:08:15.345 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.334+0000 7f0e49ece700 1 --2- 172.21.15.50:0/3388046879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e4407dac0 0x7f0e4408eb70 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f0e40008790 tx=0x7f0e4000fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:15.345 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.334+0000 7f0e49ece700 1 --2- 172.21.15.50:0/3388046879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e4407dac0 0x7f0e4408eb70 secure :-1 s=THROTTLE_DONE pgs=179 cs=0 l=1 rx=0x7f0e40008790 tx=0x7f0e4000fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:15.346 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.334+0000 7f0e48ecc700 1 -- 172.21.15.50:0/3388046879 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e40011430 con 0x7f0e4407dac0 2019-12-19T22:08:15.346 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.334+0000 7f0e48ecc700 1 -- 172.21.15.50:0/3388046879 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f0e40011750 con 0x7f0e4407dac0 2019-12-19T22:08:15.346 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.334+0000 7f0e4b931700 1 -- 172.21.15.50:0/3388046879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e4407dac0 msgr2=0x7f0e4408eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:15.346 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.334+0000 7f0e4b931700 1 --2- 172.21.15.50:0/3388046879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e4407dac0 0x7f0e4408eb70 secure :-1 s=READY pgs=179 cs=0 l=1 rx=0x7f0e40008790 tx=0x7f0e4000fbf0).stop 2019-12-19T22:08:15.346 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.334+0000 7f0e4b931700 1 -- 172.21.15.50:0/3388046879 shutdown_connections 2019-12-19T22:08:15.346 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.334+0000 7f0e4b931700 1 --2- 172.21.15.50:0/3388046879 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e4407dac0 0x7f0e4408eb70 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:15.346 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.334+0000 7f0e4b931700 1 -- 172.21.15.50:0/3388046879 shutdown_connections 2019-12-19T22:08:15.347 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.334+0000 7f0e4b931700 1 -- 172.21.15.50:0/3388046879 wait complete. 2019-12-19T22:08:15.347 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.334+0000 7f0e4b931700 1 -- 172.21.15.50:0/3388046879 >> 172.21.15.50:0/3388046879 conn(0x7f0e44092f20 msgr2=0x7f0e4408b240 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:15.347 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.335+0000 7f0e4b931700 1 Processor -- start 2019-12-19T22:08:15.347 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.335+0000 7f0e4b931700 1 -- start start 2019-12-19T22:08:15.347 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.336+0000 7f0e4b931700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0e440661b0 0x7f0e44086ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:15.348 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.336+0000 7f0e4b931700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e44089380 con 0x7f0e44065d80 2019-12-19T22:08:15.348 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.336+0000 7f0e4b931700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e44088900 con 0x7f0e440661b0 2019-12-19T22:08:15.348 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.336+0000 7f0e496cd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0e440661b0 0x7f0e44086ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:15.348 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.336+0000 7f0e496cd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f0e440661b0 0x7f0e44086ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53776/0 (socket says 172.21.15.50:53776) 2019-12-19T22:08:15.348 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.336+0000 7f0e496cd700 1 -- 172.21.15.50:0/707455203 learned_addr learned my addr 172.21.15.50:0/707455203 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:15.348 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.336+0000 7f0e496cd700 1 -- 172.21.15.50:0/707455203 >> v1:172.21.15.50:6789/0 conn(0x7f0e44065d80 legacy=0x7f0e440866a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:15.349 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.336+0000 7f0e496cd700 1 -- 172.21.15.50:0/707455203 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e44089d80 con 0x7f0e440661b0 2019-12-19T22:08:15.349 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.336+0000 7f0e496cd700 1 --2- 172.21.15.50:0/707455203 >> v2:172.21.15.50:3300/0 conn(0x7f0e440661b0 0x7f0e44086ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0e340043a0 tx=0x7f0e34010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:15.349 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.336+0000 7f0e496cd700 1 --2- 172.21.15.50:0/707455203 >> v2:172.21.15.50:3300/0 conn(0x7f0e440661b0 0x7f0e44086ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0e340043a0 tx=0x7f0e34010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:15.349 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.336+0000 7f0e496cd700 1 --2- 172.21.15.50:0/707455203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e440661b0 0x7f0e44086ea0 secure :-1 s=READY pgs=181 cs=0 l=1 rx=0x7f0e340043a0 tx=0x7f0e34010880).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:15.349 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.336+0000 7f0e496cd700 1 --2- 172.21.15.50:0/707455203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e440661b0 0x7f0e44086ea0 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7f0e340043a0 tx=0x7f0e34010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:15.349 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.336+0000 7f0e496cd700 1 --2- 172.21.15.50:0/707455203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e440661b0 0x7f0e44086ea0 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7f0e340043a0 tx=0x7f0e34010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:15.349 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.336+0000 7f0e3a7fc700 1 -- 172.21.15.50:0/707455203 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f0e34011520 con 0x7f0e440661b0 2019-12-19T22:08:15.350 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.336+0000 7f0e496cd700 1 --2- 172.21.15.50:0/707455203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e440661b0 0x7f0e44086ea0 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7f0e340043a0 tx=0x7f0e34010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:15.350 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.336+0000 7f0e3a7fc700 1 -- 172.21.15.50:0/707455203 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e34011720 con 0x7f0e440661b0 2019-12-19T22:08:15.350 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.336+0000 7f0e4b931700 1 -- 172.21.15.50:0/707455203 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e44088f90 con 0x7f0e440661b0 2019-12-19T22:08:15.350 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.336+0000 7f0e3a7fc700 1 -- 172.21.15.50:0/707455203 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f0e34011ac0 con 0x7f0e440661b0 2019-12-19T22:08:15.350 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.337+0000 7f0e4b931700 1 -- 172.21.15.50:0/707455203 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e440873f0 con 0x7f0e440661b0 2019-12-19T22:08:15.350 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.337+0000 7f0e496cd700 1 --2- 172.21.15.50:0/707455203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e440661b0 0x7f0e44086ea0 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7f0e340043a0 tx=0x7f0e34010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:15.350 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.337+0000 7f0e3a7fc700 1 -- 172.21.15.50:0/707455203 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7f0e3400b330 con 0x7f0e440661b0 2019-12-19T22:08:15.351 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.337+0000 7f0e496cd700 1 --2- 172.21.15.50:0/707455203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e440661b0 0x7f0e44086ea0 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7f0e340043a0 tx=0x7f0e34010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:15.351 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.337+0000 7f0e3a7fc700 1 --2- 172.21.15.50:0/707455203 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f0e2c01fa80 0x7f0e2c021f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:15.351 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.337+0000 7f0e3a7fc700 1 -- 172.21.15.50:0/707455203 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3403+0+0 (secure 0 0 0) 0x7f0e3402a480 con 0x7f0e440661b0 2019-12-19T22:08:15.351 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.337+0000 7f0e49ece700 1 --2- 172.21.15.50:0/707455203 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f0e2c01fa80 0x7f0e2c021f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:15.351 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.337+0000 7f0e49ece700 1 --2- 172.21.15.50:0/707455203 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f0e2c01fa80 0x7f0e2c021f90 crc :-1 s=READY pgs=44 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:15.352 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.338+0000 7f0e4b931700 1 -- 172.21.15.50:0/707455203 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e44056340 con 0x7f0e440661b0 2019-12-19T22:08:15.352 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.341+0000 7f0e496cd700 1 --2- 172.21.15.50:0/707455203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e440661b0 0x7f0e44086ea0 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7f0e340043a0 tx=0x7f0e34010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:15.352 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.341+0000 7f0e3a7fc700 1 -- 172.21.15.50:0/707455203 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7f0e34011cc0 con 0x7f0e440661b0 2019-12-19T22:08:15.483 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.480+0000 7f0e4b931700 1 -- 172.21.15.50:0/707455203 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0e4407da30 con 0x7f0e440661b0 2019-12-19T22:08:15.483 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.481+0000 7f0e496cd700 1 --2- 172.21.15.50:0/707455203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e440661b0 0x7f0e44086ea0 secure :-1 s=THROTTLE_DONE pgs=181 cs=0 l=1 rx=0x7f0e340043a0 tx=0x7f0e34010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:15.483 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.481+0000 7f0e3a7fc700 1 -- 172.21.15.50:0/707455203 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v17) v1 ==== 100+0+10 (secure 0 0 0) 0x7f0e3400b9c0 con 0x7f0e440661b0 2019-12-19T22:08:15.484 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2019-12-19T22:08:15.485 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.482+0000 7f0e4b931700 1 -- 172.21.15.50:0/707455203 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f0e2c01fa80 msgr2=0x7f0e2c021f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:15.485 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.482+0000 7f0e4b931700 1 --2- 172.21.15.50:0/707455203 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f0e2c01fa80 0x7f0e2c021f90 crc :-1 s=READY pgs=44 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:15.486 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.482+0000 7f0e4b931700 1 -- 172.21.15.50:0/707455203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e440661b0 msgr2=0x7f0e44086ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:15.486 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.482+0000 7f0e4b931700 1 --2- 172.21.15.50:0/707455203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e440661b0 0x7f0e44086ea0 secure :-1 s=READY pgs=181 cs=0 l=1 rx=0x7f0e340043a0 tx=0x7f0e34010880).stop 2019-12-19T22:08:15.486 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.482+0000 7f0e4b931700 1 -- 172.21.15.50:0/707455203 shutdown_connections 2019-12-19T22:08:15.486 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.482+0000 7f0e4b931700 1 --2- 172.21.15.50:0/707455203 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f0e2c01fa80 0x7f0e2c021f90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:15.486 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.482+0000 7f0e4b931700 1 --2- 172.21.15.50:0/707455203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0e440661b0 0x7f0e44086ea0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:15.486 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.482+0000 7f0e4b931700 1 -- 172.21.15.50:0/707455203 shutdown_connections 2019-12-19T22:08:15.486 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.482+0000 7f0e4b931700 1 -- 172.21.15.50:0/707455203 wait complete. 2019-12-19T22:08:15.487 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.482+0000 7f0e4b931700 1 -- 172.21.15.50:0/707455203 >> 172.21.15.50:0/707455203 conn(0x7f0e4408d6e0 msgr2=0x7f0e44092f20 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:15.496 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-12-19T22:08:15.612 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.607+0000 7f9a021cb700 1 Processor -- start 2019-12-19T22:08:15.613 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.607+0000 7f9a021cb700 1 -- start start 2019-12-19T22:08:15.613 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.608+0000 7f9a021cb700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f99fc089480 0x7f99fc0898b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:15.613 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.608+0000 7f9a021cb700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99fc08edb0 con 0x7f99fc08f3d0 2019-12-19T22:08:15.613 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.608+0000 7f9a021cb700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99fc08ae60 con 0x7f99fc089480 2019-12-19T22:08:15.613 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.608+0000 7f99fbfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f99fc089480 0x7f99fc0898b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:15.613 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.608+0000 7f99f3fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f99fc08f3d0 0x7f99fc081170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39908/0 (socket says 172.21.15.50:39908) 2019-12-19T22:08:15.614 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.608+0000 7f99f3fff700 1 -- 172.21.15.50:0/166157420 learned_addr learned my addr 172.21.15.50:0/166157420 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:15.614 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.608+0000 7f99fbfff700 1 -- 172.21.15.50:0/166157420 >> v1:172.21.15.50:6789/0 conn(0x7f99fc08f3d0 legacy=0x7f99fc081170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:15.614 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.608+0000 7f99fb7fe700 1 -- 172.21.15.50:0/166157420 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4018469239 0 0) 0x7f99fc08edb0 con 0x7f99fc08f3d0 2019-12-19T22:08:15.614 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.608+0000 7f99fbfff700 1 -- 172.21.15.50:0/166157420 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99fc081970 con 0x7f99fc089480 2019-12-19T22:08:15.614 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.608+0000 7f99fbfff700 1 --2- 172.21.15.50:0/166157420 >> v2:172.21.15.50:3300/0 conn(0x7f99fc089480 0x7f99fc0898b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f99ec008790 tx=0x7f99ec00fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:15.614 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.608+0000 7f99fbfff700 1 --2- 172.21.15.50:0/166157420 >> v2:172.21.15.50:3300/0 conn(0x7f99fc089480 0x7f99fc0898b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f99ec008790 tx=0x7f99ec00fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:15.615 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.608+0000 7f99fbfff700 1 --2- 172.21.15.50:0/166157420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99fc089480 0x7f99fc0898b0 secure :-1 s=READY pgs=183 cs=0 l=1 rx=0x7f99ec008790 tx=0x7f99ec00fbf0).ready entity=mon.0 client_cookie=456e8d6ba4543164 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:15.615 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.608+0000 7f99fbfff700 1 --2- 172.21.15.50:0/166157420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99fc089480 0x7f99fc0898b0 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7f99ec008790 tx=0x7f99ec00fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:15.615 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.608+0000 7f99fb7fe700 1 -- 172.21.15.50:0/166157420 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f99ec011270 con 0x7f99fc089480 2019-12-19T22:08:15.615 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.608+0000 7f99fbfff700 1 --2- 172.21.15.50:0/166157420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99fc089480 0x7f99fc0898b0 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7f99ec008790 tx=0x7f99ec00fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:15.615 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.608+0000 7f99fbfff700 1 --2- 172.21.15.50:0/166157420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99fc089480 0x7f99fc0898b0 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7f99ec008790 tx=0x7f99ec00fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:15.615 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.608+0000 7f99fb7fe700 1 -- 172.21.15.50:0/166157420 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ec011470 con 0x7f99fc089480 2019-12-19T22:08:15.615 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.608+0000 7f99fb7fe700 1 -- 172.21.15.50:0/166157420 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f99ec011790 con 0x7f99fc089480 2019-12-19T22:08:15.616 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.609+0000 7f9a021cb700 1 -- 172.21.15.50:0/166157420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99fc089480 msgr2=0x7f99fc0898b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:15.616 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.609+0000 7f9a021cb700 1 --2- 172.21.15.50:0/166157420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99fc089480 0x7f99fc0898b0 secure :-1 s=READY pgs=183 cs=0 l=1 rx=0x7f99ec008790 tx=0x7f99ec00fbf0).stop 2019-12-19T22:08:15.616 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.609+0000 7f9a021cb700 1 -- 172.21.15.50:0/166157420 shutdown_connections 2019-12-19T22:08:15.616 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.609+0000 7f9a021cb700 1 --2- 172.21.15.50:0/166157420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99fc089480 0x7f99fc0898b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:15.616 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.609+0000 7f9a021cb700 1 -- 172.21.15.50:0/166157420 shutdown_connections 2019-12-19T22:08:15.616 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.609+0000 7f9a021cb700 1 -- 172.21.15.50:0/166157420 wait complete. 2019-12-19T22:08:15.616 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.609+0000 7f9a021cb700 1 -- 172.21.15.50:0/166157420 >> 172.21.15.50:0/166157420 conn(0x7f99fc067e70 msgr2=0x7f99fc094570 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:15.617 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.610+0000 7f9a021cb700 1 Processor -- start 2019-12-19T22:08:15.617 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.610+0000 7f9a021cb700 1 -- start start 2019-12-19T22:08:15.620 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.610+0000 7f9a021cb700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f99fc064430 0x7f99fc062200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:15.620 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.610+0000 7f9a021cb700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99fc0898a0 con 0x7f99fc064860 2019-12-19T22:08:15.620 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.610+0000 7f9a021cb700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99fc0911a0 con 0x7f99fc064430 2019-12-19T22:08:15.621 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.610+0000 7f99fbfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f99fc064430 0x7f99fc062200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:15.621 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.610+0000 7f99f3fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f99fc064860 0x7f99fc062750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39914/0 (socket says 172.21.15.50:39914) 2019-12-19T22:08:15.621 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.610+0000 7f99f3fff700 1 -- 172.21.15.50:0/2782539547 learned_addr learned my addr 172.21.15.50:0/2782539547 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:15.621 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.611+0000 7f99fbfff700 1 -- 172.21.15.50:0/2782539547 >> v1:172.21.15.50:6789/0 conn(0x7f99fc064860 legacy=0x7f99fc062750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:15.621 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.611+0000 7f99fbfff700 1 -- 172.21.15.50:0/2782539547 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99fc064d30 con 0x7f99fc064430 2019-12-19T22:08:15.621 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.611+0000 7f99f97fa700 1 -- 172.21.15.50:0/2782539547 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2782256040 0 0) 0x7f99fc0898a0 con 0x7f99fc064860 2019-12-19T22:08:15.621 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.611+0000 7f99fbfff700 1 --2- 172.21.15.50:0/2782539547 >> v2:172.21.15.50:3300/0 conn(0x7f99fc064430 0x7f99fc062200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f99ec008790 tx=0x7f99ec00f490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:15.622 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.611+0000 7f99fbfff700 1 --2- 172.21.15.50:0/2782539547 >> v2:172.21.15.50:3300/0 conn(0x7f99fc064430 0x7f99fc062200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f99ec008790 tx=0x7f99ec00f490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:15.622 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.611+0000 7f99fbfff700 1 --2- 172.21.15.50:0/2782539547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99fc064430 0x7f99fc062200 secure :-1 s=READY pgs=185 cs=0 l=1 rx=0x7f99ec008790 tx=0x7f99ec00f490).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:15.622 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.611+0000 7f99fbfff700 1 --2- 172.21.15.50:0/2782539547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99fc064430 0x7f99fc062200 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f99ec008790 tx=0x7f99ec00f490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:15.622 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.611+0000 7f99f97fa700 1 -- 172.21.15.50:0/2782539547 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f99ec007150 con 0x7f99fc064430 2019-12-19T22:08:15.622 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.611+0000 7f99fbfff700 1 --2- 172.21.15.50:0/2782539547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99fc064430 0x7f99fc062200 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f99ec008790 tx=0x7f99ec00f490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:15.622 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.611+0000 7f99fbfff700 1 --2- 172.21.15.50:0/2782539547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99fc064430 0x7f99fc062200 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f99ec008790 tx=0x7f99ec00f490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:15.623 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.611+0000 7f99f97fa700 1 -- 172.21.15.50:0/2782539547 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ec007350 con 0x7f99fc064430 2019-12-19T22:08:15.623 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.611+0000 7f9a021cb700 1 -- 172.21.15.50:0/2782539547 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99fc0895a0 con 0x7f99fc064430 2019-12-19T22:08:15.623 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.611+0000 7f99f97fa700 1 -- 172.21.15.50:0/2782539547 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f99ec0115b0 con 0x7f99fc064430 2019-12-19T22:08:15.623 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.611+0000 7f9a021cb700 1 -- 172.21.15.50:0/2782539547 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99fc124700 con 0x7f99fc064430 2019-12-19T22:08:15.623 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.611+0000 7f99fbfff700 1 --2- 172.21.15.50:0/2782539547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99fc064430 0x7f99fc062200 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f99ec008790 tx=0x7f99ec00f490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:15.623 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.612+0000 7f99f97fa700 1 -- 172.21.15.50:0/2782539547 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7f99ec005540 con 0x7f99fc064430 2019-12-19T22:08:15.623 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.612+0000 7f99fbfff700 1 --2- 172.21.15.50:0/2782539547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99fc064430 0x7f99fc062200 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f99ec008790 tx=0x7f99ec00f490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:15.624 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.612+0000 7f99f97fa700 1 --2- 172.21.15.50:0/2782539547 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f99e001f9f0 0x7f99e0021f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:15.624 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.612+0000 7f99f97fa700 1 -- 172.21.15.50:0/2782539547 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3403+0+0 (secure 0 0 0) 0x7f99ec02aba0 con 0x7f99fc064430 2019-12-19T22:08:15.624 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.612+0000 7f99f3fff700 1 --2- 172.21.15.50:0/2782539547 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f99e001f9f0 0x7f99e0021f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:15.624 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.612+0000 7f99f3fff700 1 --2- 172.21.15.50:0/2782539547 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f99e001f9f0 0x7f99e0021f00 crc :-1 s=READY pgs=45 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:15.624 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.612+0000 7f9a021cb700 1 -- 172.21.15.50:0/2782539547 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99fc056340 con 0x7f99fc064430 2019-12-19T22:08:15.624 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.615+0000 7f99fbfff700 1 --2- 172.21.15.50:0/2782539547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99fc064430 0x7f99fc062200 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f99ec008790 tx=0x7f99ec00f490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:15.625 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.615+0000 7f99f97fa700 1 -- 172.21.15.50:0/2782539547 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7f99ec009dd0 con 0x7f99fc064430 2019-12-19T22:08:15.794 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.790+0000 7f9a021cb700 1 -- 172.21.15.50:0/2782539547 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99fc064fa0 con 0x7f99fc064430 2019-12-19T22:08:15.794 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.791+0000 7f99fbfff700 1 --2- 172.21.15.50:0/2782539547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99fc064430 0x7f99fc062200 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f99ec008790 tx=0x7f99ec00f490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:15.794 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.791+0000 7f99f97fa700 1 -- 172.21.15.50:0/2782539547 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+1767 (secure 0 0 0) 0x7f99ec02a680 con 0x7f99fc064430 2019-12-19T22:08:15.794 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:08:15.794 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-12-19T22:08:06.710606+0000","modified":"2019-12-19T22:08:10.714748+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4186":{"gid":4186,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":2,"addr":"172.21.15.50:6827/1500608103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1500608103},{"type":"v1","addr":"172.21.15.50:6827","nonce":1500608103}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2019-12-19T22:08:15.796 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.792+0000 7f9a021cb700 1 -- 172.21.15.50:0/2782539547 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f99e001f9f0 msgr2=0x7f99e0021f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:15.796 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.792+0000 7f9a021cb700 1 --2- 172.21.15.50:0/2782539547 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f99e001f9f0 0x7f99e0021f00 crc :-1 s=READY pgs=45 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:15.796 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.792+0000 7f9a021cb700 1 -- 172.21.15.50:0/2782539547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99fc064430 msgr2=0x7f99fc062200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:15.796 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.792+0000 7f9a021cb700 1 --2- 172.21.15.50:0/2782539547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99fc064430 0x7f99fc062200 secure :-1 s=READY pgs=185 cs=0 l=1 rx=0x7f99ec008790 tx=0x7f99ec00f490).stop 2019-12-19T22:08:15.796 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.792+0000 7f9a021cb700 1 -- 172.21.15.50:0/2782539547 shutdown_connections 2019-12-19T22:08:15.797 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.792+0000 7f9a021cb700 1 --2- 172.21.15.50:0/2782539547 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f99e001f9f0 0x7f99e0021f00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:15.797 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.792+0000 7f9a021cb700 1 --2- 172.21.15.50:0/2782539547 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99fc064430 0x7f99fc062200 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:15.797 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.792+0000 7f9a021cb700 1 -- 172.21.15.50:0/2782539547 shutdown_connections 2019-12-19T22:08:15.797 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.792+0000 7f9a021cb700 1 -- 172.21.15.50:0/2782539547 wait complete. 2019-12-19T22:08:15.797 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:15.792+0000 7f9a021cb700 1 -- 172.21.15.50:0/2782539547 >> 172.21.15.50:0/2782539547 conn(0x7f99fc081c40 msgr2=0x7f99fc08cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:15.797 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 6 2019-12-19T22:08:15.910 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4186}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 2, u'failed': [], u'epoch': 6, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [3], u'info': {u'gid_4186': {u'export_targets': [], u'name': u'a', u'incarnation': 5, u'state_seq': 2, u'state': u'up:active', u'gid': 4186, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 1500608103, u'type': u'v2', u'addr': u'172.21.15.50:6826'}, {u'nonce': 1500608103, u'type': u'v1', u'addr': u'172.21.15.50:6827'}]}, u'addr': u'172.21.15.50:6827/1500608103'}}, u'fs_name': u'cephfs', u'created': u'2019-12-19T22:08:06.710606+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-12-19T22:08:10.714748+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-12-19T22:08:15.910 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-12-19T22:08:15.910 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2019-12-19T22:08:16.039 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2019-12-19T22:08:16.039 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "c1382993-41cc-4b35-a402-c17778701f01", 2019-12-19T22:08:16.039 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2019-12-19T22:08:16.039 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4186, 2019-12-19T22:08:16.040 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2019-12-19T22:08:16.040 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2019-12-19T22:08:16.040 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 6.3235373539999999, 2019-12-19T22:08:16.040 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 6, 2019-12-19T22:08:16.040 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 17, 2019-12-19T22:08:16.041 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 17, 2019-12-19T22:08:16.041 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 6.9677352719999996 2019-12-19T22:08:16.041 INFO:teuthology.orchestra.run.smithi050.stdout:} 2019-12-19T22:08:16.057 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "c1382993-41cc-4b35-a402-c17778701f01", "whoami": 0, "id": 4186, "want_state": "up:active", "state": "up:active", "rank_uptime": 6.3235373539999999, "mdsmap_epoch": 6, "osdmap_epoch": 17, "osdmap_epoch_barrier": 17, "uptime": 6.9677352719999996 } 2019-12-19T22:08:16.057 INFO:teuthology.run_tasks:Running task exec... 2019-12-19T22:08:16.072 INFO:teuthology.task.exec:Executing custom commands... 2019-12-19T22:08:16.072 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi050.front.sepia.ceph.com 2019-12-19T22:08:16.073 INFO:teuthology.orchestra.run.smithi050:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd pool create data_cache 4' 2019-12-19T22:08:16.189 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.183+0000 7f22f44bf700 1 Processor -- start 2019-12-19T22:08:16.189 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.184+0000 7f22f44bf700 1 -- start start 2019-12-19T22:08:16.189 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.184+0000 7f22f44bf700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f22ec0751b0 0x7f22ec0775f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:16.189 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.184+0000 7f22f44bf700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22ec08fad0 con 0x7f22ec08cf50 2019-12-19T22:08:16.189 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.184+0000 7f22f44bf700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22ec068760 con 0x7f22ec0751b0 2019-12-19T22:08:16.189 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.184+0000 7f22f225b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f22ec0751b0 0x7f22ec0775f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:16.190 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.184+0000 7f22f225b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f22ec0751b0 0x7f22ec0775f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53792/0 (socket says 172.21.15.50:53792) 2019-12-19T22:08:16.190 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.184+0000 7f22f225b700 1 -- 172.21.15.50:0/1323948239 learned_addr learned my addr 172.21.15.50:0/1323948239 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:16.190 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.184+0000 7f22f2a5c700 1 --1- 172.21.15.50:0/1323948239 >> v1:172.21.15.50:6789/0 conn(0x7f22ec08cf50 0x7f22ec08d380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39918/0 (socket says 172.21.15.50:39918) 2019-12-19T22:08:16.190 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.185+0000 7f22f225b700 1 -- 172.21.15.50:0/1323948239 >> v1:172.21.15.50:6789/0 conn(0x7f22ec08cf50 legacy=0x7f22ec08d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:16.190 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.185+0000 7f22f225b700 1 -- 172.21.15.50:0/1323948239 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ec08eb70 con 0x7f22ec0751b0 2019-12-19T22:08:16.190 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.185+0000 7f22f1a5a700 1 -- 172.21.15.50:0/1323948239 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2823978953 0 0) 0x7f22ec08fad0 con 0x7f22ec08cf50 2019-12-19T22:08:16.190 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.185+0000 7f22f225b700 1 --2- 172.21.15.50:0/1323948239 >> v2:172.21.15.50:3300/0 conn(0x7f22ec0751b0 0x7f22ec0775f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f22dc008790 tx=0x7f22dc00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:16.191 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.185+0000 7f22f225b700 1 --2- 172.21.15.50:0/1323948239 >> v2:172.21.15.50:3300/0 conn(0x7f22ec0751b0 0x7f22ec0775f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f22dc008790 tx=0x7f22dc00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:16.191 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.185+0000 7f22f225b700 1 --2- 172.21.15.50:0/1323948239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22ec0751b0 0x7f22ec0775f0 secure :-1 s=READY pgs=187 cs=0 l=1 rx=0x7f22dc008790 tx=0x7f22dc00fcb0).ready entity=mon.0 client_cookie=66ae2861cd034240 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:16.191 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.185+0000 7f22f225b700 1 --2- 172.21.15.50:0/1323948239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22ec0751b0 0x7f22ec0775f0 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7f22dc008790 tx=0x7f22dc00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:16.191 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.185+0000 7f22f1a5a700 1 -- 172.21.15.50:0/1323948239 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f22dc011330 con 0x7f22ec0751b0 2019-12-19T22:08:16.191 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.185+0000 7f22f225b700 1 --2- 172.21.15.50:0/1323948239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22ec0751b0 0x7f22ec0775f0 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7f22dc008790 tx=0x7f22dc00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:16.191 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.185+0000 7f22f225b700 1 --2- 172.21.15.50:0/1323948239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22ec0751b0 0x7f22ec0775f0 secure :-1 s=THROTTLE_DONE pgs=187 cs=0 l=1 rx=0x7f22dc008790 tx=0x7f22dc00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:16.191 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.185+0000 7f22f1a5a700 1 -- 172.21.15.50:0/1323948239 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22dc011530 con 0x7f22ec0751b0 2019-12-19T22:08:16.192 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.185+0000 7f22f1a5a700 1 -- 172.21.15.50:0/1323948239 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f22dc011850 con 0x7f22ec0751b0 2019-12-19T22:08:16.192 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.185+0000 7f22f44bf700 1 -- 172.21.15.50:0/1323948239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22ec0751b0 msgr2=0x7f22ec0775f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:16.192 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.185+0000 7f22f44bf700 1 --2- 172.21.15.50:0/1323948239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22ec0751b0 0x7f22ec0775f0 secure :-1 s=READY pgs=187 cs=0 l=1 rx=0x7f22dc008790 tx=0x7f22dc00fcb0).stop 2019-12-19T22:08:16.192 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.185+0000 7f22f44bf700 1 -- 172.21.15.50:0/1323948239 shutdown_connections 2019-12-19T22:08:16.192 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.185+0000 7f22f44bf700 1 --2- 172.21.15.50:0/1323948239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22ec0751b0 0x7f22ec0775f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:16.192 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.185+0000 7f22f44bf700 1 -- 172.21.15.50:0/1323948239 shutdown_connections 2019-12-19T22:08:16.192 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.185+0000 7f22f44bf700 1 -- 172.21.15.50:0/1323948239 wait complete. 2019-12-19T22:08:16.193 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.185+0000 7f22f44bf700 1 -- 172.21.15.50:0/1323948239 >> 172.21.15.50:0/1323948239 conn(0x7f22ec095420 msgr2=0x7f22ec08b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:16.193 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.186+0000 7f22f44bf700 1 Processor -- start 2019-12-19T22:08:16.193 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.186+0000 7f22f44bf700 1 -- start start 2019-12-19T22:08:16.196 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.187+0000 7f22f44bf700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f22ec121250 0x7f22ec123690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:16.196 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.187+0000 7f22f44bf700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22ec06efe0 con 0x7f22ec11aeb0 2019-12-19T22:08:16.196 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.187+0000 7f22f44bf700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22ec072e00 con 0x7f22ec121250 2019-12-19T22:08:16.197 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.187+0000 7f22f2a5c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f22ec11aeb0 0x7f22ec11b2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39922/0 (socket says 172.21.15.50:39922) 2019-12-19T22:08:16.197 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.187+0000 7f22f2a5c700 1 -- 172.21.15.50:0/783964738 learned_addr learned my addr 172.21.15.50:0/783964738 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:16.197 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.187+0000 7f22f225b700 1 --2- 172.21.15.50:0/783964738 >> v2:172.21.15.50:3300/0 conn(0x7f22ec121250 0x7f22ec123690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:16.197 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.187+0000 7f22e37fe700 1 -- 172.21.15.50:0/783964738 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3346592540 0 0) 0x7f22ec06efe0 con 0x7f22ec11aeb0 2019-12-19T22:08:16.197 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.187+0000 7f22e37fe700 1 -- 172.21.15.50:0/783964738 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22d40030b0 con 0x7f22ec11aeb0 2019-12-19T22:08:16.197 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.187+0000 7f22f225b700 1 -- 172.21.15.50:0/783964738 >> v1:172.21.15.50:6789/0 conn(0x7f22ec11aeb0 legacy=0x7f22ec11b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:16.197 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.187+0000 7f22f225b700 1 -- 172.21.15.50:0/783964738 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ec070770 con 0x7f22ec121250 2019-12-19T22:08:16.198 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.187+0000 7f22f225b700 1 --2- 172.21.15.50:0/783964738 >> v2:172.21.15.50:3300/0 conn(0x7f22ec121250 0x7f22ec123690 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f22dc008790 tx=0x7f22dc00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:16.198 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.187+0000 7f22f225b700 1 --2- 172.21.15.50:0/783964738 >> v2:172.21.15.50:3300/0 conn(0x7f22ec121250 0x7f22ec123690 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f22dc008790 tx=0x7f22dc00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:16.198 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.187+0000 7f22f225b700 1 --2- 172.21.15.50:0/783964738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22ec121250 0x7f22ec123690 secure :-1 s=READY pgs=189 cs=0 l=1 rx=0x7f22dc008790 tx=0x7f22dc00f780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:16.198 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.187+0000 7f22f225b700 1 --2- 172.21.15.50:0/783964738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22ec121250 0x7f22ec123690 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f22dc008790 tx=0x7f22dc00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:16.198 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.187+0000 7f22e37fe700 1 -- 172.21.15.50:0/783964738 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f22dc007280 con 0x7f22ec121250 2019-12-19T22:08:16.198 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.187+0000 7f22f225b700 1 --2- 172.21.15.50:0/783964738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22ec121250 0x7f22ec123690 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f22dc008790 tx=0x7f22dc00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:16.198 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.187+0000 7f22f225b700 1 --2- 172.21.15.50:0/783964738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22ec121250 0x7f22ec123690 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f22dc008790 tx=0x7f22dc00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:16.199 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.187+0000 7f22e37fe700 1 -- 172.21.15.50:0/783964738 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22dc011540 con 0x7f22ec121250 2019-12-19T22:08:16.199 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.187+0000 7f22f44bf700 1 -- 172.21.15.50:0/783964738 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22ec06e150 con 0x7f22ec121250 2019-12-19T22:08:16.199 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.187+0000 7f22e37fe700 1 -- 172.21.15.50:0/783964738 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f22dc011860 con 0x7f22ec121250 2019-12-19T22:08:16.199 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.188+0000 7f22f44bf700 1 -- 172.21.15.50:0/783964738 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22ec06f820 con 0x7f22ec121250 2019-12-19T22:08:16.199 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.188+0000 7f22f225b700 1 --2- 172.21.15.50:0/783964738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22ec121250 0x7f22ec123690 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f22dc008790 tx=0x7f22dc00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:16.199 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.188+0000 7f22e37fe700 1 -- 172.21.15.50:0/783964738 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7f22dc005540 con 0x7f22ec121250 2019-12-19T22:08:16.199 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.188+0000 7f22f225b700 1 --2- 172.21.15.50:0/783964738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22ec121250 0x7f22ec123690 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f22dc008790 tx=0x7f22dc00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:16.200 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.188+0000 7f22e37fe700 1 --2- 172.21.15.50:0/783964738 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f22d401fff0 0x7f22d4022500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:16.200 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.188+0000 7f22e37fe700 1 -- 172.21.15.50:0/783964738 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3403+0+0 (secure 0 0 0) 0x7f22dc02aa90 con 0x7f22ec121250 2019-12-19T22:08:16.200 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.188+0000 7f22f2a5c700 1 --2- 172.21.15.50:0/783964738 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f22d401fff0 0x7f22d4022500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:16.200 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.188+0000 7f22f2a5c700 1 --2- 172.21.15.50:0/783964738 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f22d401fff0 0x7f22d4022500 crc :-1 s=READY pgs=46 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:16.201 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.189+0000 7f22f44bf700 1 -- 172.21.15.50:0/783964738 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22ec056340 con 0x7f22ec121250 2019-12-19T22:08:16.201 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.192+0000 7f22f225b700 1 --2- 172.21.15.50:0/783964738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22ec121250 0x7f22ec123690 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f22dc008790 tx=0x7f22dc00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:16.201 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.192+0000 7f22e37fe700 1 -- 172.21.15.50:0/783964738 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7f22dc005dc0 con 0x7f22ec121250 2019-12-19T22:08:16.331 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.329+0000 7f22f44bf700 1 -- 172.21.15.50:0/783964738 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "data_cache", "pg_num": 4} v 0) v1 -- 0x7f22ec08f150 con 0x7f22ec121250 2019-12-19T22:08:16.390 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.387+0000 7f22f225b700 1 --2- 172.21.15.50:0/783964738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22ec121250 0x7f22ec123690 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f22dc008790 tx=0x7f22dc00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:16.390 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.387+0000 7f22e37fe700 1 -- 172.21.15.50:0/783964738 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "data_cache", "pg_num": 4}]=0 pool 'data_cache' created v18) v1 ==== 123+0+0 (secure 0 0 0) 0x7f22dc0058a0 con 0x7f22ec121250 2019-12-19T22:08:16.392 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.390+0000 7f22f44bf700 1 -- 172.21.15.50:0/783964738 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f22d401fff0 msgr2=0x7f22d4022500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:16.392 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.390+0000 7f22f44bf700 1 --2- 172.21.15.50:0/783964738 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f22d401fff0 0x7f22d4022500 crc :-1 s=READY pgs=46 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:16.392 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.390+0000 7f22f44bf700 1 -- 172.21.15.50:0/783964738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22ec121250 msgr2=0x7f22ec123690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:16.393 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.390+0000 7f22f44bf700 1 --2- 172.21.15.50:0/783964738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22ec121250 0x7f22ec123690 secure :-1 s=READY pgs=189 cs=0 l=1 rx=0x7f22dc008790 tx=0x7f22dc00f780).stop 2019-12-19T22:08:16.393 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.390+0000 7f22f44bf700 1 -- 172.21.15.50:0/783964738 shutdown_connections 2019-12-19T22:08:16.393 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.390+0000 7f22f44bf700 1 --2- 172.21.15.50:0/783964738 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f22d401fff0 0x7f22d4022500 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:16.393 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.390+0000 7f22f44bf700 1 --2- 172.21.15.50:0/783964738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22ec121250 0x7f22ec123690 secure :-1 s=CLOSED pgs=189 cs=0 l=1 rx=0x7f22dc008790 tx=0x7f22dc00f780).stop 2019-12-19T22:08:16.393 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.390+0000 7f22f44bf700 1 -- 172.21.15.50:0/783964738 shutdown_connections 2019-12-19T22:08:16.393 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.390+0000 7f22f44bf700 1 -- 172.21.15.50:0/783964738 wait complete. 2019-12-19T22:08:16.393 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.390+0000 7f22f44bf700 1 -- 172.21.15.50:0/783964738 >> 172.21.15.50:0/783964738 conn(0x7f22ec075480 msgr2=0x7f22ec07dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:16.394 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'data_cache' created 2019-12-19T22:08:16.403 INFO:teuthology.orchestra.run.smithi050:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd tier add cephfs_data data_cache' 2019-12-19T22:08:16.522 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.514+0000 7f5740e3d700 1 Processor -- start 2019-12-19T22:08:16.522 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.514+0000 7f5740e3d700 1 -- start start 2019-12-19T22:08:16.523 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.515+0000 7f5740e3d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f573c08cf50 0x7f573c08d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:16.523 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.515+0000 7f5740e3d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f573c08fad0 con 0x7f573c080960 2019-12-19T22:08:16.523 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.515+0000 7f5740e3d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f573c068760 con 0x7f573c08cf50 2019-12-19T22:08:16.523 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.515+0000 7f573ad9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f573c08cf50 0x7f573c08d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:16.523 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.515+0000 7f573ad9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f573c08cf50 0x7f573c08d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53800/0 (socket says 172.21.15.50:53800) 2019-12-19T22:08:16.523 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.515+0000 7f573ad9d700 1 -- 172.21.15.50:0/3649380709 learned_addr learned my addr 172.21.15.50:0/3649380709 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:16.523 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.515+0000 7f573ad9d700 1 -- 172.21.15.50:0/3649380709 >> v1:172.21.15.50:6789/0 conn(0x7f573c080960 legacy=0x7f573c080d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:16.524 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.515+0000 7f573ad9d700 1 -- 172.21.15.50:0/3649380709 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f573c08eb70 con 0x7f573c08cf50 2019-12-19T22:08:16.524 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.515+0000 7f573ad9d700 1 --2- 172.21.15.50:0/3649380709 >> v2:172.21.15.50:3300/0 conn(0x7f573c08cf50 0x7f573c08d380 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f572c008790 tx=0x7f572c00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:16.524 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.515+0000 7f573ad9d700 1 --2- 172.21.15.50:0/3649380709 >> v2:172.21.15.50:3300/0 conn(0x7f573c08cf50 0x7f573c08d380 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f572c008790 tx=0x7f572c00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:16.524 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.515+0000 7f573ad9d700 1 --2- 172.21.15.50:0/3649380709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f573c08cf50 0x7f573c08d380 secure :-1 s=READY pgs=191 cs=0 l=1 rx=0x7f572c008790 tx=0x7f572c00fcb0).ready entity=mon.0 client_cookie=1e86617496b76bc9 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:16.524 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.515+0000 7f573ad9d700 1 --2- 172.21.15.50:0/3649380709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f573c08cf50 0x7f573c08d380 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f572c008790 tx=0x7f572c00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:16.524 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.515+0000 7f5739d9b700 1 -- 172.21.15.50:0/3649380709 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f572c011330 con 0x7f573c08cf50 2019-12-19T22:08:16.524 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.515+0000 7f573ad9d700 1 --2- 172.21.15.50:0/3649380709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f573c08cf50 0x7f573c08d380 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f572c008790 tx=0x7f572c00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:16.525 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.515+0000 7f573ad9d700 1 --2- 172.21.15.50:0/3649380709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f573c08cf50 0x7f573c08d380 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f572c008790 tx=0x7f572c00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:16.525 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.515+0000 7f5739d9b700 1 -- 172.21.15.50:0/3649380709 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f572c011530 con 0x7f573c08cf50 2019-12-19T22:08:16.525 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.515+0000 7f5739d9b700 1 -- 172.21.15.50:0/3649380709 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f572c011850 con 0x7f573c08cf50 2019-12-19T22:08:16.525 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.515+0000 7f5740e3d700 1 -- 172.21.15.50:0/3649380709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f573c08cf50 msgr2=0x7f573c08d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:16.525 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.515+0000 7f5740e3d700 1 --2- 172.21.15.50:0/3649380709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f573c08cf50 0x7f573c08d380 secure :-1 s=READY pgs=191 cs=0 l=1 rx=0x7f572c008790 tx=0x7f572c00fcb0).stop 2019-12-19T22:08:16.525 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.516+0000 7f5740e3d700 1 -- 172.21.15.50:0/3649380709 shutdown_connections 2019-12-19T22:08:16.526 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.516+0000 7f5740e3d700 1 --2- 172.21.15.50:0/3649380709 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f573c08cf50 0x7f573c08d380 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:16.526 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.516+0000 7f5740e3d700 1 -- 172.21.15.50:0/3649380709 shutdown_connections 2019-12-19T22:08:16.526 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.516+0000 7f5740e3d700 1 -- 172.21.15.50:0/3649380709 wait complete. 2019-12-19T22:08:16.526 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.516+0000 7f5740e3d700 1 -- 172.21.15.50:0/3649380709 >> 172.21.15.50:0/3649380709 conn(0x7f573c095420 msgr2=0x7f573c08b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:16.526 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.517+0000 7f5740e3d700 1 Processor -- start 2019-12-19T22:08:16.526 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.517+0000 7f5740e3d700 1 -- start start 2019-12-19T22:08:16.526 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.517+0000 7f5740e3d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f573c065c20 0x7f573c062ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:16.526 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.517+0000 7f5740e3d700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f573c0655c0 con 0x7f573c063440 2019-12-19T22:08:16.527 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.517+0000 7f5740e3d700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f573c064a50 con 0x7f573c065c20 2019-12-19T22:08:16.527 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.517+0000 7f573a59c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f573c063440 0x7f573c122b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39930/0 (socket says 172.21.15.50:39930) 2019-12-19T22:08:16.527 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.518+0000 7f573ad9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f573c065c20 0x7f573c062ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:16.527 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.518+0000 7f573a59c700 1 -- 172.21.15.50:0/1586461758 learned_addr learned my addr 172.21.15.50:0/1586461758 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:16.527 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.518+0000 7f573ad9d700 1 -- 172.21.15.50:0/1586461758 >> v1:172.21.15.50:6789/0 conn(0x7f573c063440 legacy=0x7f573c122b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:16.527 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.518+0000 7f573ad9d700 1 -- 172.21.15.50:0/1586461758 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f573c065970 con 0x7f573c065c20 2019-12-19T22:08:16.527 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.518+0000 7f57337fe700 1 -- 172.21.15.50:0/1586461758 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 55746661 0 0) 0x7f573c0655c0 con 0x7f573c063440 2019-12-19T22:08:16.528 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.518+0000 7f573ad9d700 1 --2- 172.21.15.50:0/1586461758 >> v2:172.21.15.50:3300/0 conn(0x7f573c065c20 0x7f573c062ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f572c008790 tx=0x7f572c00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:16.528 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.518+0000 7f573ad9d700 1 --2- 172.21.15.50:0/1586461758 >> v2:172.21.15.50:3300/0 conn(0x7f573c065c20 0x7f573c062ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f572c008790 tx=0x7f572c00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:16.528 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.518+0000 7f573ad9d700 1 --2- 172.21.15.50:0/1586461758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f573c065c20 0x7f573c062ef0 secure :-1 s=READY pgs=193 cs=0 l=1 rx=0x7f572c008790 tx=0x7f572c00f780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:16.528 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.518+0000 7f573ad9d700 1 --2- 172.21.15.50:0/1586461758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f573c065c20 0x7f573c062ef0 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7f572c008790 tx=0x7f572c00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:16.528 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.518+0000 7f57337fe700 1 -- 172.21.15.50:0/1586461758 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f572c007280 con 0x7f573c065c20 2019-12-19T22:08:16.528 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.518+0000 7f573ad9d700 1 --2- 172.21.15.50:0/1586461758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f573c065c20 0x7f573c062ef0 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7f572c008790 tx=0x7f572c00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:16.528 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.518+0000 7f57337fe700 1 -- 172.21.15.50:0/1586461758 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f572c0115c0 con 0x7f573c065c20 2019-12-19T22:08:16.529 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.518+0000 7f573ad9d700 1 --2- 172.21.15.50:0/1586461758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f573c065c20 0x7f573c062ef0 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7f572c008790 tx=0x7f572c00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:16.529 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.518+0000 7f5740e3d700 1 -- 172.21.15.50:0/1586461758 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f573c07e180 con 0x7f573c065c20 2019-12-19T22:08:16.529 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.518+0000 7f57337fe700 1 -- 172.21.15.50:0/1586461758 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f572c0118e0 con 0x7f573c065c20 2019-12-19T22:08:16.529 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.518+0000 7f5740e3d700 1 -- 172.21.15.50:0/1586461758 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f573c081b70 con 0x7f573c065c20 2019-12-19T22:08:16.529 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.519+0000 7f573ad9d700 1 --2- 172.21.15.50:0/1586461758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f573c065c20 0x7f573c062ef0 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7f572c008790 tx=0x7f572c00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:16.529 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.519+0000 7f57337fe700 1 -- 172.21.15.50:0/1586461758 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7f572c005540 con 0x7f573c065c20 2019-12-19T22:08:16.529 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.519+0000 7f573ad9d700 1 --2- 172.21.15.50:0/1586461758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f573c065c20 0x7f573c062ef0 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7f572c008790 tx=0x7f572c00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:16.530 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.519+0000 7f57337fe700 1 --2- 172.21.15.50:0/1586461758 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f5718021bc0 0x7f57180240d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:16.530 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.519+0000 7f57337fe700 1 -- 172.21.15.50:0/1586461758 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3752+0+0 (secure 0 0 0) 0x7f572c02aa20 con 0x7f573c065c20 2019-12-19T22:08:16.530 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.519+0000 7f573a59c700 1 --2- 172.21.15.50:0/1586461758 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f5718021bc0 0x7f57180240d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:16.530 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.519+0000 7f573a59c700 1 --2- 172.21.15.50:0/1586461758 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f5718021bc0 0x7f57180240d0 crc :-1 s=READY pgs=47 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:16.530 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.519+0000 7f5740e3d700 1 -- 172.21.15.50:0/1586461758 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f573c056340 con 0x7f573c065c20 2019-12-19T22:08:16.531 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.523+0000 7f573ad9d700 1 --2- 172.21.15.50:0/1586461758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f573c065c20 0x7f573c062ef0 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7f572c008790 tx=0x7f572c00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:16.531 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.523+0000 7f57337fe700 1 -- 172.21.15.50:0/1586461758 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7f572c005d70 con 0x7f573c065c20 2019-12-19T22:08:16.688 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:16.685+0000 7f5740e3d700 1 -- 172.21.15.50:0/1586461758 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd tier add", "pool": "cephfs_data", "tierpool": "data_cache"} v 0) v1 -- 0x7f573c081ea0 con 0x7f573c065c20 2019-12-19T22:08:17.391 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.389+0000 7f573ad9d700 1 --2- 172.21.15.50:0/1586461758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f573c065c20 0x7f573c062ef0 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7f572c008790 tx=0x7f572c00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:17.392 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.389+0000 7f57337fe700 1 -- 172.21.15.50:0/1586461758 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd tier add", "pool": "cephfs_data", "tierpool": "data_cache"}]=0 pool 'data_cache' is now (or already was) a tier of 'cephfs_data' v19) v1 ==== 174+0+0 (secure 0 0 0) 0x7f572c005850 con 0x7f573c065c20 2019-12-19T22:08:17.403 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.394+0000 7f5740e3d700 1 -- 172.21.15.50:0/1586461758 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f5718021bc0 msgr2=0x7f57180240d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:17.403 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.394+0000 7f5740e3d700 1 --2- 172.21.15.50:0/1586461758 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f5718021bc0 0x7f57180240d0 crc :-1 s=READY pgs=47 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:17.403 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.394+0000 7f5740e3d700 1 -- 172.21.15.50:0/1586461758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f573c065c20 msgr2=0x7f573c062ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:17.404 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.394+0000 7f5740e3d700 1 --2- 172.21.15.50:0/1586461758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f573c065c20 0x7f573c062ef0 secure :-1 s=READY pgs=193 cs=0 l=1 rx=0x7f572c008790 tx=0x7f572c00f780).stop 2019-12-19T22:08:17.404 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.394+0000 7f5740e3d700 1 -- 172.21.15.50:0/1586461758 shutdown_connections 2019-12-19T22:08:17.404 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.394+0000 7f5740e3d700 1 --2- 172.21.15.50:0/1586461758 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f5718021bc0 0x7f57180240d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:17.404 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.394+0000 7f5740e3d700 1 --2- 172.21.15.50:0/1586461758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f573c065c20 0x7f573c062ef0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:17.404 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.394+0000 7f5740e3d700 1 -- 172.21.15.50:0/1586461758 shutdown_connections 2019-12-19T22:08:17.404 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.394+0000 7f5740e3d700 1 -- 172.21.15.50:0/1586461758 wait complete. 2019-12-19T22:08:17.404 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.394+0000 7f5740e3d700 1 -- 172.21.15.50:0/1586461758 >> 172.21.15.50:0/1586461758 conn(0x7f573c094360 msgr2=0x7f573c08b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:17.405 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'data_cache' is now (or already was) a tier of 'cephfs_data' 2019-12-19T22:08:17.410 INFO:teuthology.orchestra.run.smithi050:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd tier cache-mode data_cache writeback' 2019-12-19T22:08:17.538 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.530+0000 7fa7bd747700 1 Processor -- start 2019-12-19T22:08:17.538 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.530+0000 7fa7bd747700 1 -- start start 2019-12-19T22:08:17.538 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.531+0000 7fa7bd747700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa7b80751b0 0x7fa7b80775f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:17.538 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.531+0000 7fa7bd747700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7b808fad0 con 0x7fa7b808cf50 2019-12-19T22:08:17.538 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.531+0000 7fa7bd747700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7b8068760 con 0x7fa7b80751b0 2019-12-19T22:08:17.539 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.531+0000 7fa7b6ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa7b80751b0 0x7fa7b80775f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:17.539 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.531+0000 7fa7b6ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa7b80751b0 0x7fa7b80775f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53808/0 (socket says 172.21.15.50:53808) 2019-12-19T22:08:17.539 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.531+0000 7fa7b6ffd700 1 -- 172.21.15.50:0/2432044246 learned_addr learned my addr 172.21.15.50:0/2432044246 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:17.539 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.531+0000 7fa7b77fe700 1 --1- 172.21.15.50:0/2432044246 >> v1:172.21.15.50:6789/0 conn(0x7fa7b808cf50 0x7fa7b808d380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39936/0 (socket says 172.21.15.50:39936) 2019-12-19T22:08:17.539 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.531+0000 7fa7b6ffd700 1 -- 172.21.15.50:0/2432044246 >> v1:172.21.15.50:6789/0 conn(0x7fa7b808cf50 legacy=0x7fa7b808d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:17.539 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.531+0000 7fa7b6ffd700 1 -- 172.21.15.50:0/2432044246 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b808eb70 con 0x7fa7b80751b0 2019-12-19T22:08:17.539 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.531+0000 7fa7b6ffd700 1 --2- 172.21.15.50:0/2432044246 >> v2:172.21.15.50:3300/0 conn(0x7fa7b80751b0 0x7fa7b80775f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa7ac008790 tx=0x7fa7ac00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:17.540 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.531+0000 7fa7b6ffd700 1 --2- 172.21.15.50:0/2432044246 >> v2:172.21.15.50:3300/0 conn(0x7fa7b80751b0 0x7fa7b80775f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa7ac008790 tx=0x7fa7ac00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:17.540 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.531+0000 7fa7b6ffd700 1 --2- 172.21.15.50:0/2432044246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7b80751b0 0x7fa7b80775f0 secure :-1 s=READY pgs=195 cs=0 l=1 rx=0x7fa7ac008790 tx=0x7fa7ac00fcb0).ready entity=mon.0 client_cookie=3847eefd14174929 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:17.540 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.531+0000 7fa7b6ffd700 1 --2- 172.21.15.50:0/2432044246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7b80751b0 0x7fa7b80775f0 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7fa7ac008790 tx=0x7fa7ac00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:17.540 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.531+0000 7fa7b67fc700 1 -- 172.21.15.50:0/2432044246 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fa7ac011330 con 0x7fa7b80751b0 2019-12-19T22:08:17.545 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.531+0000 7fa7b6ffd700 1 --2- 172.21.15.50:0/2432044246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7b80751b0 0x7fa7b80775f0 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7fa7ac008790 tx=0x7fa7ac00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:17.545 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.531+0000 7fa7b6ffd700 1 --2- 172.21.15.50:0/2432044246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7b80751b0 0x7fa7b80775f0 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7fa7ac008790 tx=0x7fa7ac00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:17.545 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.531+0000 7fa7b67fc700 1 -- 172.21.15.50:0/2432044246 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7ac011530 con 0x7fa7b80751b0 2019-12-19T22:08:17.545 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.531+0000 7fa7b67fc700 1 -- 172.21.15.50:0/2432044246 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fa7ac011850 con 0x7fa7b80751b0 2019-12-19T22:08:17.545 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.531+0000 7fa7bd747700 1 -- 172.21.15.50:0/2432044246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7b80751b0 msgr2=0x7fa7b80775f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:17.545 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.531+0000 7fa7bd747700 1 --2- 172.21.15.50:0/2432044246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7b80751b0 0x7fa7b80775f0 secure :-1 s=READY pgs=195 cs=0 l=1 rx=0x7fa7ac008790 tx=0x7fa7ac00fcb0).stop 2019-12-19T22:08:17.545 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.532+0000 7fa7bd747700 1 -- 172.21.15.50:0/2432044246 shutdown_connections 2019-12-19T22:08:17.546 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.532+0000 7fa7bd747700 1 --2- 172.21.15.50:0/2432044246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7b80751b0 0x7fa7b80775f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:17.546 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.532+0000 7fa7bd747700 1 -- 172.21.15.50:0/2432044246 shutdown_connections 2019-12-19T22:08:17.546 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.532+0000 7fa7bd747700 1 -- 172.21.15.50:0/2432044246 wait complete. 2019-12-19T22:08:17.546 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.532+0000 7fa7bd747700 1 -- 172.21.15.50:0/2432044246 >> 172.21.15.50:0/2432044246 conn(0x7fa7b8095420 msgr2=0x7fa7b808b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:17.546 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.533+0000 7fa7bd747700 1 Processor -- start 2019-12-19T22:08:17.546 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.533+0000 7fa7bd747700 1 -- start start 2019-12-19T22:08:17.546 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.534+0000 7fa7bd747700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa7b80811a0 0x7fa7b8121640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:17.547 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.534+0000 7fa7bd747700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7b8073df0 con 0x7fa7b8121b90 2019-12-19T22:08:17.547 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.534+0000 7fa7bd747700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7b81213a0 con 0x7fa7b80811a0 2019-12-19T22:08:17.547 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.534+0000 7fa7b77fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa7b80811a0 0x7fa7b8121640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:17.547 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.534+0000 7fa7b6ffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa7b8121b90 0x7fa7b808fde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39938/0 (socket says 172.21.15.50:39938) 2019-12-19T22:08:17.547 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.534+0000 7fa7b6ffd700 1 -- 172.21.15.50:0/2448233602 learned_addr learned my addr 172.21.15.50:0/2448233602 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:17.547 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.534+0000 7fa7b77fe700 1 -- 172.21.15.50:0/2448233602 >> v1:172.21.15.50:6789/0 conn(0x7fa7b8121b90 legacy=0x7fa7b808fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:17.547 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.534+0000 7fa79ffff700 1 -- 172.21.15.50:0/2448233602 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1804448063 0 0) 0x7fa7b8073df0 con 0x7fa7b8121b90 2019-12-19T22:08:17.548 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.534+0000 7fa7b77fe700 1 -- 172.21.15.50:0/2448233602 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b80806f0 con 0x7fa7b80811a0 2019-12-19T22:08:17.548 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.534+0000 7fa7b77fe700 1 --2- 172.21.15.50:0/2448233602 >> v2:172.21.15.50:3300/0 conn(0x7fa7b80811a0 0x7fa7b8121640 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa7a80013e0 tx=0x7fa7a800c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:17.548 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.534+0000 7fa7b77fe700 1 --2- 172.21.15.50:0/2448233602 >> v2:172.21.15.50:3300/0 conn(0x7fa7b80811a0 0x7fa7b8121640 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa7a80013e0 tx=0x7fa7a800c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:17.548 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.534+0000 7fa7b77fe700 1 --2- 172.21.15.50:0/2448233602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7b80811a0 0x7fa7b8121640 secure :-1 s=READY pgs=197 cs=0 l=1 rx=0x7fa7a80013e0 tx=0x7fa7a800c340).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:17.548 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.534+0000 7fa7b77fe700 1 --2- 172.21.15.50:0/2448233602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7b80811a0 0x7fa7b8121640 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7fa7a80013e0 tx=0x7fa7a800c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:17.548 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.534+0000 7fa79ffff700 1 -- 172.21.15.50:0/2448233602 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fa7a80114e0 con 0x7fa7b80811a0 2019-12-19T22:08:17.548 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.534+0000 7fa7b77fe700 1 --2- 172.21.15.50:0/2448233602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7b80811a0 0x7fa7b8121640 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7fa7a80013e0 tx=0x7fa7a800c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:17.549 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.534+0000 7fa7b77fe700 1 --2- 172.21.15.50:0/2448233602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7b80811a0 0x7fa7b8121640 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7fa7a80013e0 tx=0x7fa7a800c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:17.549 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.534+0000 7fa79ffff700 1 -- 172.21.15.50:0/2448233602 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a80116e0 con 0x7fa7b80811a0 2019-12-19T22:08:17.549 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.534+0000 7fa7bd747700 1 -- 172.21.15.50:0/2448233602 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7b8080200 con 0x7fa7b80811a0 2019-12-19T22:08:17.549 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.534+0000 7fa79ffff700 1 -- 172.21.15.50:0/2448233602 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fa7a8011a80 con 0x7fa7b80811a0 2019-12-19T22:08:17.549 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.534+0000 7fa7bd747700 1 -- 172.21.15.50:0/2448233602 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7b8122180 con 0x7fa7b80811a0 2019-12-19T22:08:17.549 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.535+0000 7fa7b77fe700 1 --2- 172.21.15.50:0/2448233602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7b80811a0 0x7fa7b8121640 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7fa7a80013e0 tx=0x7fa7a800c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:17.549 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.535+0000 7fa79ffff700 1 -- 172.21.15.50:0/2448233602 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7fa7a8006460 con 0x7fa7b80811a0 2019-12-19T22:08:17.550 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.535+0000 7fa7b77fe700 1 --2- 172.21.15.50:0/2448233602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7b80811a0 0x7fa7b8121640 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7fa7a80013e0 tx=0x7fa7a800c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:17.550 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.535+0000 7fa79ffff700 1 --2- 172.21.15.50:0/2448233602 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fa79801f940 0x7fa798021e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:17.550 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.535+0000 7fa79ffff700 1 -- 172.21.15.50:0/2448233602 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3760+0+0 (secure 0 0 0) 0x7fa7a802a1b0 con 0x7fa7b80811a0 2019-12-19T22:08:17.550 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.535+0000 7fa7b6ffd700 1 --2- 172.21.15.50:0/2448233602 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fa79801f940 0x7fa798021e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:17.550 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.535+0000 7fa7b6ffd700 1 --2- 172.21.15.50:0/2448233602 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fa79801f940 0x7fa798021e50 crc :-1 s=READY pgs=48 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:17.550 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.535+0000 7fa7bd747700 1 -- 172.21.15.50:0/2448233602 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7b8056340 con 0x7fa7b80811a0 2019-12-19T22:08:17.551 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.539+0000 7fa7b77fe700 1 --2- 172.21.15.50:0/2448233602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7b80811a0 0x7fa7b8121640 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7fa7a80013e0 tx=0x7fa7a800c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:17.551 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.539+0000 7fa79ffff700 1 -- 172.21.15.50:0/2448233602 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7fa7a800c3c0 con 0x7fa7b80811a0 2019-12-19T22:08:17.700 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:17.698+0000 7fa7bd747700 1 -- 172.21.15.50:0/2448233602 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd tier cache-mode", "pool": "data_cache", "mode": "writeback"} v 0) v1 -- 0x7fa7b808f150 con 0x7fa7b80811a0 2019-12-19T22:08:18.396 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.393+0000 7fa7b77fe700 1 --2- 172.21.15.50:0/2448233602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7b80811a0 0x7fa7b8121640 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7fa7a80013e0 tx=0x7fa7a800c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:18.396 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.393+0000 7fa79ffff700 1 -- 172.21.15.50:0/2448233602 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd tier cache-mode", "pool": "data_cache", "mode": "writeback"}]=0 set cache-mode for pool 'data_cache' to writeback v20) v1 ==== 159+0+0 (secure 0 0 0) 0x7fa7a8006af0 con 0x7fa7b80811a0 2019-12-19T22:08:18.398 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.395+0000 7fa7bd747700 1 -- 172.21.15.50:0/2448233602 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fa79801f940 msgr2=0x7fa798021e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:18.398 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.395+0000 7fa7bd747700 1 --2- 172.21.15.50:0/2448233602 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fa79801f940 0x7fa798021e50 crc :-1 s=READY pgs=48 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:18.398 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.395+0000 7fa7bd747700 1 -- 172.21.15.50:0/2448233602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7b80811a0 msgr2=0x7fa7b8121640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:18.399 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.395+0000 7fa7bd747700 1 --2- 172.21.15.50:0/2448233602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7b80811a0 0x7fa7b8121640 secure :-1 s=READY pgs=197 cs=0 l=1 rx=0x7fa7a80013e0 tx=0x7fa7a800c340).stop 2019-12-19T22:08:18.399 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.396+0000 7fa7bd747700 1 -- 172.21.15.50:0/2448233602 shutdown_connections 2019-12-19T22:08:18.399 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.396+0000 7fa7bd747700 1 --2- 172.21.15.50:0/2448233602 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fa79801f940 0x7fa798021e50 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:18.399 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.396+0000 7fa7bd747700 1 --2- 172.21.15.50:0/2448233602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa7b80811a0 0x7fa7b8121640 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:18.399 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.396+0000 7fa7bd747700 1 -- 172.21.15.50:0/2448233602 shutdown_connections 2019-12-19T22:08:18.399 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.396+0000 7fa7bd747700 1 -- 172.21.15.50:0/2448233602 wait complete. 2019-12-19T22:08:18.400 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.396+0000 7fa7bd747700 1 -- 172.21.15.50:0/2448233602 >> 172.21.15.50:0/2448233602 conn(0x7fa7b8094310 msgr2=0x7fa7b8076a60 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:18.400 INFO:teuthology.orchestra.run.smithi050.stderr:set cache-mode for pool 'data_cache' to writeback 2019-12-19T22:08:18.410 INFO:teuthology.orchestra.run.smithi050:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd tier set-overlay cephfs_data data_cache' 2019-12-19T22:08:18.537 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.529+0000 7f17cf7f3700 1 Processor -- start 2019-12-19T22:08:18.537 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.529+0000 7f17cf7f3700 1 -- start start 2019-12-19T22:08:18.537 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.530+0000 7f17cf7f3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f17c80751b0 0x7f17c80775f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:18.537 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.530+0000 7f17cf7f3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17c808fad0 con 0x7f17c808cf50 2019-12-19T22:08:18.537 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.530+0000 7f17cf7f3700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17c8068760 con 0x7f17c80751b0 2019-12-19T22:08:18.537 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.530+0000 7f17cd58f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f17c80751b0 0x7f17c80775f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:18.538 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.530+0000 7f17cdd90700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f17c808cf50 0x7f17c808d380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39942/0 (socket says 172.21.15.50:39942) 2019-12-19T22:08:18.538 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.530+0000 7f17cd58f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f17c80751b0 0x7f17c80775f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53814/0 (socket says 172.21.15.50:53814) 2019-12-19T22:08:18.538 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.530+0000 7f17cdd90700 1 -- 172.21.15.50:0/1800439471 learned_addr learned my addr 172.21.15.50:0/1800439471 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:18.538 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.530+0000 7f17cd58f700 1 -- 172.21.15.50:0/1800439471 >> v1:172.21.15.50:6789/0 conn(0x7f17c808cf50 legacy=0x7f17c808d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:18.538 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.530+0000 7f17cd58f700 1 -- 172.21.15.50:0/1800439471 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c808eb70 con 0x7f17c80751b0 2019-12-19T22:08:18.538 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.530+0000 7f17ccd8e700 1 -- 172.21.15.50:0/1800439471 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 278243550 0 0) 0x7f17c808fad0 con 0x7f17c808cf50 2019-12-19T22:08:18.538 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.530+0000 7f17cd58f700 1 --2- 172.21.15.50:0/1800439471 >> v2:172.21.15.50:3300/0 conn(0x7f17c80751b0 0x7f17c80775f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f17b8008790 tx=0x7f17b800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:18.539 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.530+0000 7f17cd58f700 1 --2- 172.21.15.50:0/1800439471 >> v2:172.21.15.50:3300/0 conn(0x7f17c80751b0 0x7f17c80775f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f17b8008790 tx=0x7f17b800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:18.539 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.530+0000 7f17cd58f700 1 --2- 172.21.15.50:0/1800439471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17c80751b0 0x7f17c80775f0 secure :-1 s=READY pgs=199 cs=0 l=1 rx=0x7f17b8008790 tx=0x7f17b800fbf0).ready entity=mon.0 client_cookie=9a7da5e37437c846 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:18.539 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.530+0000 7f17cd58f700 1 --2- 172.21.15.50:0/1800439471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17c80751b0 0x7f17c80775f0 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7f17b8008790 tx=0x7f17b800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:18.539 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.530+0000 7f17ccd8e700 1 -- 172.21.15.50:0/1800439471 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f17b8011270 con 0x7f17c80751b0 2019-12-19T22:08:18.539 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.530+0000 7f17cd58f700 1 --2- 172.21.15.50:0/1800439471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17c80751b0 0x7f17c80775f0 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7f17b8008790 tx=0x7f17b800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:18.539 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.530+0000 7f17ccd8e700 1 -- 172.21.15.50:0/1800439471 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b8011470 con 0x7f17c80751b0 2019-12-19T22:08:18.539 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.530+0000 7f17cd58f700 1 --2- 172.21.15.50:0/1800439471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17c80751b0 0x7f17c80775f0 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7f17b8008790 tx=0x7f17b800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:18.540 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.530+0000 7f17ccd8e700 1 -- 172.21.15.50:0/1800439471 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f17b8011790 con 0x7f17c80751b0 2019-12-19T22:08:18.540 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.531+0000 7f17cf7f3700 1 -- 172.21.15.50:0/1800439471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17c80751b0 msgr2=0x7f17c80775f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:18.540 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.531+0000 7f17cf7f3700 1 --2- 172.21.15.50:0/1800439471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17c80751b0 0x7f17c80775f0 secure :-1 s=READY pgs=199 cs=0 l=1 rx=0x7f17b8008790 tx=0x7f17b800fbf0).stop 2019-12-19T22:08:18.540 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.531+0000 7f17cf7f3700 1 -- 172.21.15.50:0/1800439471 shutdown_connections 2019-12-19T22:08:18.540 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.531+0000 7f17cf7f3700 1 --2- 172.21.15.50:0/1800439471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17c80751b0 0x7f17c80775f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:18.541 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.531+0000 7f17cf7f3700 1 -- 172.21.15.50:0/1800439471 shutdown_connections 2019-12-19T22:08:18.541 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.531+0000 7f17cf7f3700 1 -- 172.21.15.50:0/1800439471 wait complete. 2019-12-19T22:08:18.542 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.531+0000 7f17cf7f3700 1 -- 172.21.15.50:0/1800439471 >> 172.21.15.50:0/1800439471 conn(0x7f17c8095420 msgr2=0x7f17c808b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:18.542 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.532+0000 7f17cf7f3700 1 Processor -- start 2019-12-19T22:08:18.542 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.532+0000 7f17cf7f3700 1 -- start start 2019-12-19T22:08:18.542 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.532+0000 7f17cf7f3700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f17c8122410 0x7f17c8124850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:18.542 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.532+0000 7f17cf7f3700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17c8070920 con 0x7f17c808fde0 2019-12-19T22:08:18.542 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.532+0000 7f17cf7f3700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17c806f350 con 0x7f17c8122410 2019-12-19T22:08:18.542 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.532+0000 7f17cdd90700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f17c808fde0 0x7f17c8090210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39946/0 (socket says 172.21.15.50:39946) 2019-12-19T22:08:18.543 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.532+0000 7f17cdd90700 1 -- 172.21.15.50:0/1061277083 learned_addr learned my addr 172.21.15.50:0/1061277083 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:18.543 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.532+0000 7f17cd58f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f17c8122410 0x7f17c8124850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:18.543 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.533+0000 7f17cd58f700 1 -- 172.21.15.50:0/1061277083 >> v1:172.21.15.50:6789/0 conn(0x7f17c808fde0 legacy=0x7f17c8090210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:18.543 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.533+0000 7f17cd58f700 1 -- 172.21.15.50:0/1061277083 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c806faa0 con 0x7f17c8122410 2019-12-19T22:08:18.543 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.533+0000 7f17be7fc700 1 -- 172.21.15.50:0/1061277083 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2052956279 0 0) 0x7f17c8070920 con 0x7f17c808fde0 2019-12-19T22:08:18.543 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.533+0000 7f17cd58f700 1 --2- 172.21.15.50:0/1061277083 >> v2:172.21.15.50:3300/0 conn(0x7f17c8122410 0x7f17c8124850 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f17b8008790 tx=0x7f17b800f530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:18.544 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.533+0000 7f17cd58f700 1 --2- 172.21.15.50:0/1061277083 >> v2:172.21.15.50:3300/0 conn(0x7f17c8122410 0x7f17c8124850 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f17b8008790 tx=0x7f17b800f530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:18.544 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.533+0000 7f17cd58f700 1 --2- 172.21.15.50:0/1061277083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17c8122410 0x7f17c8124850 secure :-1 s=READY pgs=201 cs=0 l=1 rx=0x7f17b8008790 tx=0x7f17b800f530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:18.544 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.533+0000 7f17cd58f700 1 --2- 172.21.15.50:0/1061277083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17c8122410 0x7f17c8124850 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7f17b8008790 tx=0x7f17b800f530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:18.544 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.533+0000 7f17be7fc700 1 -- 172.21.15.50:0/1061277083 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f17b8007280 con 0x7f17c8122410 2019-12-19T22:08:18.544 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.533+0000 7f17cd58f700 1 --2- 172.21.15.50:0/1061277083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17c8122410 0x7f17c8124850 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7f17b8008790 tx=0x7f17b800f530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:18.544 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.533+0000 7f17be7fc700 1 -- 172.21.15.50:0/1061277083 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b8011480 con 0x7f17c8122410 2019-12-19T22:08:18.544 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.533+0000 7f17cd58f700 1 --2- 172.21.15.50:0/1061277083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17c8122410 0x7f17c8124850 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7f17b8008790 tx=0x7f17b800f530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:18.545 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.533+0000 7f17cf7f3700 1 -- 172.21.15.50:0/1061277083 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17c8071490 con 0x7f17c8122410 2019-12-19T22:08:18.545 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.533+0000 7f17be7fc700 1 -- 172.21.15.50:0/1061277083 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f17b80117a0 con 0x7f17c8122410 2019-12-19T22:08:18.545 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.533+0000 7f17cf7f3700 1 -- 172.21.15.50:0/1061277083 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17c806fee0 con 0x7f17c8122410 2019-12-19T22:08:18.545 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.533+0000 7f17cd58f700 1 --2- 172.21.15.50:0/1061277083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17c8122410 0x7f17c8124850 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7f17b8008790 tx=0x7f17b800f530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:18.545 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.534+0000 7f17be7fc700 1 -- 172.21.15.50:0/1061277083 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7f17b8005540 con 0x7f17c8122410 2019-12-19T22:08:18.545 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.534+0000 7f17cd58f700 1 --2- 172.21.15.50:0/1061277083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17c8122410 0x7f17c8124850 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7f17b8008790 tx=0x7f17b800f530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:18.545 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.534+0000 7f17be7fc700 1 --2- 172.21.15.50:0/1061277083 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f17b001f9a0 0x7f17b0021eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:18.546 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.534+0000 7f17be7fc700 1 -- 172.21.15.50:0/1061277083 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3760+0+0 (secure 0 0 0) 0x7f17b802ac90 con 0x7f17c8122410 2019-12-19T22:08:18.546 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.534+0000 7f17cdd90700 1 --2- 172.21.15.50:0/1061277083 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f17b001f9a0 0x7f17b0021eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:18.546 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.534+0000 7f17cdd90700 1 --2- 172.21.15.50:0/1061277083 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f17b001f9a0 0x7f17b0021eb0 crc :-1 s=READY pgs=49 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:18.546 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.534+0000 7f17cf7f3700 1 -- 172.21.15.50:0/1061277083 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17c8056340 con 0x7f17c8122410 2019-12-19T22:08:18.546 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.538+0000 7f17cd58f700 1 --2- 172.21.15.50:0/1061277083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17c8122410 0x7f17c8124850 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7f17b8008790 tx=0x7f17b800f530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:18.547 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.538+0000 7f17be7fc700 1 -- 172.21.15.50:0/1061277083 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7f17b8005dc0 con 0x7f17c8122410 2019-12-19T22:08:18.701 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:18.699+0000 7f17cf7f3700 1 -- 172.21.15.50:0/1061277083 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd tier set-overlay", "pool": "cephfs_data", "overlaypool": "data_cache"} v 0) v1 -- 0x7f17c808f150 con 0x7f17c8122410 2019-12-19T22:08:19.398 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.395+0000 7f17cd58f700 1 --2- 172.21.15.50:0/1061277083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17c8122410 0x7f17c8124850 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7f17b8008790 tx=0x7f17b800f530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:19.515 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.395+0000 7f17be7fc700 1 -- 172.21.15.50:0/1061277083 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd tier set-overlay", "pool": "cephfs_data", "overlaypool": "data_cache"}]=0 overlay for 'cephfs_data' is now (or already was) 'data_cache' v21) v1 ==== 182+0+0 (secure 0 0 0) 0x7f17b80058a0 con 0x7f17c8122410 2019-12-19T22:08:19.517 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.397+0000 7f17cf7f3700 1 -- 172.21.15.50:0/1061277083 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f17b001f9a0 msgr2=0x7f17b0021eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:19.517 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.397+0000 7f17cf7f3700 1 --2- 172.21.15.50:0/1061277083 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f17b001f9a0 0x7f17b0021eb0 crc :-1 s=READY pgs=49 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:19.517 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.397+0000 7f17cf7f3700 1 -- 172.21.15.50:0/1061277083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17c8122410 msgr2=0x7f17c8124850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:19.517 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.397+0000 7f17cf7f3700 1 --2- 172.21.15.50:0/1061277083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17c8122410 0x7f17c8124850 secure :-1 s=READY pgs=201 cs=0 l=1 rx=0x7f17b8008790 tx=0x7f17b800f530).stop 2019-12-19T22:08:19.517 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.397+0000 7f17cf7f3700 1 -- 172.21.15.50:0/1061277083 shutdown_connections 2019-12-19T22:08:19.517 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.397+0000 7f17cf7f3700 1 --2- 172.21.15.50:0/1061277083 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f17b001f9a0 0x7f17b0021eb0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:19.518 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.397+0000 7f17cf7f3700 1 --2- 172.21.15.50:0/1061277083 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17c8122410 0x7f17c8124850 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:19.518 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.397+0000 7f17cf7f3700 1 -- 172.21.15.50:0/1061277083 shutdown_connections 2019-12-19T22:08:19.518 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.397+0000 7f17cf7f3700 1 -- 172.21.15.50:0/1061277083 wait complete. 2019-12-19T22:08:19.518 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.397+0000 7f17cf7f3700 1 -- 172.21.15.50:0/1061277083 >> 172.21.15.50:0/1061277083 conn(0x7f17c8075480 msgr2=0x7f17c807dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:19.518 INFO:teuthology.orchestra.run.smithi050.stderr:overlay for 'cephfs_data' is now (or already was) 'data_cache' 2019-12-19T22:08:19.519 INFO:teuthology.orchestra.run.smithi050:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd pool set data_cache hit_set_type bloom' 2019-12-19T22:08:19.648 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.643+0000 7f4cab081700 1 Processor -- start 2019-12-19T22:08:19.649 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.643+0000 7f4cab081700 1 -- start start 2019-12-19T22:08:19.649 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.643+0000 7f4cab081700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4ca407e450 0x7f4ca4089a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:19.649 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.643+0000 7f4cab081700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ca408f220 con 0x7f4ca407e020 2019-12-19T22:08:19.649 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.643+0000 7f4cab081700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ca408f4f0 con 0x7f4ca407e450 2019-12-19T22:08:19.649 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.643+0000 7f4ca8e1d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4ca407e450 0x7f4ca4089a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:19.650 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.644+0000 7f4ca8e1d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4ca407e450 0x7f4ca4089a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53826/0 (socket says 172.21.15.50:53826) 2019-12-19T22:08:19.650 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.644+0000 7f4ca8e1d700 1 -- 172.21.15.50:0/142640141 learned_addr learned my addr 172.21.15.50:0/142640141 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:19.650 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.644+0000 7f4ca961e700 1 --1- 172.21.15.50:0/142640141 >> v1:172.21.15.50:6789/0 conn(0x7f4ca407e020 0x7f4ca4089250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39952/0 (socket says 172.21.15.50:39952) 2019-12-19T22:08:19.650 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.644+0000 7f4ca8e1d700 1 -- 172.21.15.50:0/142640141 >> v1:172.21.15.50:6789/0 conn(0x7f4ca407e020 legacy=0x7f4ca4089250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:19.650 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.644+0000 7f4ca8e1d700 1 -- 172.21.15.50:0/142640141 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca407dbb0 con 0x7f4ca407e450 2019-12-19T22:08:19.650 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.644+0000 7f4ca8e1d700 1 --2- 172.21.15.50:0/142640141 >> v2:172.21.15.50:3300/0 conn(0x7f4ca407e450 0x7f4ca4089a50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4c94008790 tx=0x7f4c9400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:19.650 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.644+0000 7f4ca8e1d700 1 --2- 172.21.15.50:0/142640141 >> v2:172.21.15.50:3300/0 conn(0x7f4ca407e450 0x7f4ca4089a50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4c94008790 tx=0x7f4c9400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:19.651 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.644+0000 7f4ca8e1d700 1 --2- 172.21.15.50:0/142640141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ca407e450 0x7f4ca4089a50 secure :-1 s=READY pgs=203 cs=0 l=1 rx=0x7f4c94008790 tx=0x7f4c9400fcb0).ready entity=mon.0 client_cookie=f8d81504013af08b server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:19.651 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.644+0000 7f4ca8e1d700 1 --2- 172.21.15.50:0/142640141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ca407e450 0x7f4ca4089a50 secure :-1 s=THROTTLE_DONE pgs=203 cs=0 l=1 rx=0x7f4c94008790 tx=0x7f4c9400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:19.651 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.644+0000 7f4c9bfff700 1 -- 172.21.15.50:0/142640141 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f4c94011330 con 0x7f4ca407e450 2019-12-19T22:08:19.651 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.644+0000 7f4ca8e1d700 1 --2- 172.21.15.50:0/142640141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ca407e450 0x7f4ca4089a50 secure :-1 s=THROTTLE_DONE pgs=203 cs=0 l=1 rx=0x7f4c94008790 tx=0x7f4c9400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:19.651 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.644+0000 7f4ca8e1d700 1 --2- 172.21.15.50:0/142640141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ca407e450 0x7f4ca4089a50 secure :-1 s=THROTTLE_DONE pgs=203 cs=0 l=1 rx=0x7f4c94008790 tx=0x7f4c9400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:19.651 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.644+0000 7f4c9bfff700 1 -- 172.21.15.50:0/142640141 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c94011530 con 0x7f4ca407e450 2019-12-19T22:08:19.651 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.644+0000 7f4c9bfff700 1 -- 172.21.15.50:0/142640141 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f4c94011850 con 0x7f4ca407e450 2019-12-19T22:08:19.652 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.644+0000 7f4cab081700 1 -- 172.21.15.50:0/142640141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ca407e450 msgr2=0x7f4ca4089a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:19.652 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.644+0000 7f4cab081700 1 --2- 172.21.15.50:0/142640141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ca407e450 0x7f4ca4089a50 secure :-1 s=READY pgs=203 cs=0 l=1 rx=0x7f4c94008790 tx=0x7f4c9400fcb0).stop 2019-12-19T22:08:19.652 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.645+0000 7f4cab081700 1 -- 172.21.15.50:0/142640141 shutdown_connections 2019-12-19T22:08:19.652 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.645+0000 7f4cab081700 1 --2- 172.21.15.50:0/142640141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ca407e450 0x7f4ca4089a50 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:19.652 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.645+0000 7f4cab081700 1 -- 172.21.15.50:0/142640141 shutdown_connections 2019-12-19T22:08:19.652 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.645+0000 7f4cab081700 1 -- 172.21.15.50:0/142640141 wait complete. 2019-12-19T22:08:19.652 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.645+0000 7f4cab081700 1 -- 172.21.15.50:0/142640141 >> 172.21.15.50:0/142640141 conn(0x7f4ca40952d0 msgr2=0x7f4ca408b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:19.653 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.646+0000 7f4cab081700 1 Processor -- start 2019-12-19T22:08:19.653 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.646+0000 7f4cab081700 1 -- start start 2019-12-19T22:08:19.656 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.646+0000 7f4cab081700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4ca4064460 0x7f4ca4064890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:19.656 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.646+0000 7f4cab081700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ca4065210 con 0x7f4ca4064de0 2019-12-19T22:08:19.656 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.646+0000 7f4cab081700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ca4065510 con 0x7f4ca4064460 2019-12-19T22:08:19.656 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.646+0000 7f4ca961e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4ca4064460 0x7f4ca4064890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:19.657 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.646+0000 7f4ca961e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4ca4064460 0x7f4ca4064890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53828/0 (socket says 172.21.15.50:53828) 2019-12-19T22:08:19.657 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.646+0000 7f4ca8e1d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4ca4064de0 0x7f4ca4122a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39958/0 (socket says 172.21.15.50:39958) 2019-12-19T22:08:19.657 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.646+0000 7f4ca961e700 1 -- 172.21.15.50:0/401663901 learned_addr learned my addr 172.21.15.50:0/401663901 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:19.657 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.647+0000 7f4ca961e700 1 -- 172.21.15.50:0/401663901 >> v1:172.21.15.50:6789/0 conn(0x7f4ca4064de0 legacy=0x7f4ca4122a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:19.657 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.647+0000 7f4c99ffb700 1 -- 172.21.15.50:0/401663901 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 617117627 0 0) 0x7f4ca4065210 con 0x7f4ca4064de0 2019-12-19T22:08:19.657 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.647+0000 7f4ca961e700 1 -- 172.21.15.50:0/401663901 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca4064150 con 0x7f4ca4064460 2019-12-19T22:08:19.658 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.647+0000 7f4ca961e700 1 --2- 172.21.15.50:0/401663901 >> v2:172.21.15.50:3300/0 conn(0x7f4ca4064460 0x7f4ca4064890 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4ca0001450 tx=0x7f4ca0010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:19.658 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.647+0000 7f4ca961e700 1 --2- 172.21.15.50:0/401663901 >> v2:172.21.15.50:3300/0 conn(0x7f4ca4064460 0x7f4ca4064890 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4ca0001450 tx=0x7f4ca0010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:19.658 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.647+0000 7f4ca961e700 1 --2- 172.21.15.50:0/401663901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ca4064460 0x7f4ca4064890 secure :-1 s=READY pgs=205 cs=0 l=1 rx=0x7f4ca0001450 tx=0x7f4ca0010940).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:19.658 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.647+0000 7f4ca961e700 1 --2- 172.21.15.50:0/401663901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ca4064460 0x7f4ca4064890 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7f4ca0001450 tx=0x7f4ca0010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:19.658 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.647+0000 7f4ca961e700 1 --2- 172.21.15.50:0/401663901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ca4064460 0x7f4ca4064890 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7f4ca0001450 tx=0x7f4ca0010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:19.658 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.647+0000 7f4c99ffb700 1 -- 172.21.15.50:0/401663901 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f4ca0011430 con 0x7f4ca4064460 2019-12-19T22:08:19.658 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.647+0000 7f4ca961e700 1 --2- 172.21.15.50:0/401663901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ca4064460 0x7f4ca4064890 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7f4ca0001450 tx=0x7f4ca0010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:19.659 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.647+0000 7f4c99ffb700 1 -- 172.21.15.50:0/401663901 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ca0011630 con 0x7f4ca4064460 2019-12-19T22:08:19.659 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.647+0000 7f4cab081700 1 -- 172.21.15.50:0/401663901 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ca4063230 con 0x7f4ca4064460 2019-12-19T22:08:19.659 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.647+0000 7f4c99ffb700 1 -- 172.21.15.50:0/401663901 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f4ca0011a10 con 0x7f4ca4064460 2019-12-19T22:08:19.659 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.647+0000 7f4cab081700 1 -- 172.21.15.50:0/401663901 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ca4062c60 con 0x7f4ca4064460 2019-12-19T22:08:19.659 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.647+0000 7f4ca961e700 1 --2- 172.21.15.50:0/401663901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ca4064460 0x7f4ca4064890 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7f4ca0001450 tx=0x7f4ca0010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:19.660 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.648+0000 7f4c99ffb700 1 -- 172.21.15.50:0/401663901 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7f4ca0006460 con 0x7f4ca4064460 2019-12-19T22:08:19.660 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.648+0000 7f4ca961e700 1 --2- 172.21.15.50:0/401663901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ca4064460 0x7f4ca4064890 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7f4ca0001450 tx=0x7f4ca0010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:19.660 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.648+0000 7f4c99ffb700 1 --2- 172.21.15.50:0/401663901 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f4c8401f9d0 0x7f4c84021ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:19.660 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.648+0000 7f4c99ffb700 1 -- 172.21.15.50:0/401663901 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3760+0+0 (secure 0 0 0) 0x7f4ca002a0f0 con 0x7f4ca4064460 2019-12-19T22:08:19.660 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.648+0000 7f4ca8e1d700 1 --2- 172.21.15.50:0/401663901 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f4c8401f9d0 0x7f4c84021ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:19.660 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.648+0000 7f4ca8e1d700 1 --2- 172.21.15.50:0/401663901 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f4c8401f9d0 0x7f4c84021ee0 crc :-1 s=READY pgs=50 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:19.660 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.648+0000 7f4cab081700 1 -- 172.21.15.50:0/401663901 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ca4056340 con 0x7f4ca4064460 2019-12-19T22:08:19.661 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.651+0000 7f4ca961e700 1 --2- 172.21.15.50:0/401663901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ca4064460 0x7f4ca4064890 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7f4ca0001450 tx=0x7f4ca0010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:19.661 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.651+0000 7f4c99ffb700 1 -- 172.21.15.50:0/401663901 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7f4ca0006810 con 0x7f4ca4064460 2019-12-19T22:08:19.793 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:19.788+0000 7f4cab081700 1 -- 172.21.15.50:0/401663901 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "data_cache", "var": "hit_set_type", "val": "bloom"} v 0) v1 -- 0x7f4ca406a140 con 0x7f4ca4064460 2019-12-19T22:08:20.405 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.398+0000 7f4ca961e700 1 --2- 172.21.15.50:0/401663901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ca4064460 0x7f4ca4064890 secure :-1 s=THROTTLE_DONE pgs=205 cs=0 l=1 rx=0x7f4ca0001450 tx=0x7f4ca0010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:20.405 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.398+0000 7f4c99ffb700 1 -- 172.21.15.50:0/401663901 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "data_cache", "var": "hit_set_type", "val": "bloom"}]=0 set pool 4 hit_set_type to bloom v22) v1 ==== 153+0+0 (secure 0 0 0) 0x7f4ca0029bd0 con 0x7f4ca4064460 2019-12-19T22:08:20.406 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.400+0000 7f4cab081700 1 -- 172.21.15.50:0/401663901 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f4c8401f9d0 msgr2=0x7f4c84021ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:20.406 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.400+0000 7f4cab081700 1 --2- 172.21.15.50:0/401663901 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f4c8401f9d0 0x7f4c84021ee0 crc :-1 s=READY pgs=50 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:20.406 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.400+0000 7f4cab081700 1 -- 172.21.15.50:0/401663901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ca4064460 msgr2=0x7f4ca4064890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:20.406 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.400+0000 7f4cab081700 1 --2- 172.21.15.50:0/401663901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ca4064460 0x7f4ca4064890 secure :-1 s=READY pgs=205 cs=0 l=1 rx=0x7f4ca0001450 tx=0x7f4ca0010940).stop 2019-12-19T22:08:20.407 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.400+0000 7f4cab081700 1 -- 172.21.15.50:0/401663901 shutdown_connections 2019-12-19T22:08:20.407 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.400+0000 7f4cab081700 1 --2- 172.21.15.50:0/401663901 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f4c8401f9d0 0x7f4c84021ee0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:20.407 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.400+0000 7f4cab081700 1 --2- 172.21.15.50:0/401663901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4ca4064460 0x7f4ca4064890 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:20.407 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.400+0000 7f4cab081700 1 -- 172.21.15.50:0/401663901 shutdown_connections 2019-12-19T22:08:20.407 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.400+0000 7f4cab081700 1 -- 172.21.15.50:0/401663901 wait complete. 2019-12-19T22:08:20.407 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.400+0000 7f4cab081700 1 -- 172.21.15.50:0/401663901 >> 172.21.15.50:0/401663901 conn(0x7f4ca408d8c0 msgr2=0x7f4ca408bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:20.407 INFO:teuthology.orchestra.run.smithi050.stderr:set pool 4 hit_set_type to bloom 2019-12-19T22:08:20.415 INFO:teuthology.orchestra.run.smithi050:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd pool set data_cache hit_set_count 8' 2019-12-19T22:08:20.539 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.534+0000 7ff08eea4700 1 Processor -- start 2019-12-19T22:08:20.540 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.534+0000 7ff08eea4700 1 -- start start 2019-12-19T22:08:20.540 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.535+0000 7ff08eea4700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff08807e450 0x7ff088089a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:20.540 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.535+0000 7ff08eea4700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff08808f220 con 0x7ff08807e020 2019-12-19T22:08:20.540 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.535+0000 7ff08eea4700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff08808f4f0 con 0x7ff08807e450 2019-12-19T22:08:20.540 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.535+0000 7ff08cc40700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff08807e450 0x7ff088089a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:20.540 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.535+0000 7ff08d441700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff08807e020 0x7ff088089250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39964/0 (socket says 172.21.15.50:39964) 2019-12-19T22:08:20.541 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.535+0000 7ff08d441700 1 -- 172.21.15.50:0/2565383594 learned_addr learned my addr 172.21.15.50:0/2565383594 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:20.541 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.535+0000 7ff08cc40700 1 -- 172.21.15.50:0/2565383594 >> v1:172.21.15.50:6789/0 conn(0x7ff08807e020 legacy=0x7ff088089250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:20.541 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.535+0000 7ff07ffff700 1 -- 172.21.15.50:0/2565383594 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1416475799 0 0) 0x7ff08808f220 con 0x7ff08807e020 2019-12-19T22:08:20.541 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.535+0000 7ff08cc40700 1 -- 172.21.15.50:0/2565383594 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff08807dbb0 con 0x7ff08807e450 2019-12-19T22:08:20.541 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.535+0000 7ff08cc40700 1 --2- 172.21.15.50:0/2565383594 >> v2:172.21.15.50:3300/0 conn(0x7ff08807e450 0x7ff088089a50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff078008790 tx=0x7ff07800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:20.541 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.535+0000 7ff08cc40700 1 --2- 172.21.15.50:0/2565383594 >> v2:172.21.15.50:3300/0 conn(0x7ff08807e450 0x7ff088089a50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff078008790 tx=0x7ff07800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:20.541 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.535+0000 7ff08cc40700 1 --2- 172.21.15.50:0/2565383594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff08807e450 0x7ff088089a50 secure :-1 s=READY pgs=207 cs=0 l=1 rx=0x7ff078008790 tx=0x7ff07800fbf0).ready entity=mon.0 client_cookie=25e86e00e57e0d5 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:20.542 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.536+0000 7ff08cc40700 1 --2- 172.21.15.50:0/2565383594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff08807e450 0x7ff088089a50 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7ff078008790 tx=0x7ff07800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:20.542 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.536+0000 7ff07ffff700 1 -- 172.21.15.50:0/2565383594 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7ff078011270 con 0x7ff08807e450 2019-12-19T22:08:20.542 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.536+0000 7ff08cc40700 1 --2- 172.21.15.50:0/2565383594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff08807e450 0x7ff088089a50 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7ff078008790 tx=0x7ff07800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:20.542 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.536+0000 7ff07ffff700 1 -- 172.21.15.50:0/2565383594 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff078011470 con 0x7ff08807e450 2019-12-19T22:08:20.542 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.536+0000 7ff08cc40700 1 --2- 172.21.15.50:0/2565383594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff08807e450 0x7ff088089a50 secure :-1 s=THROTTLE_DONE pgs=207 cs=0 l=1 rx=0x7ff078008790 tx=0x7ff07800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:20.542 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.536+0000 7ff07ffff700 1 -- 172.21.15.50:0/2565383594 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7ff078011790 con 0x7ff08807e450 2019-12-19T22:08:20.543 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.536+0000 7ff08eea4700 1 -- 172.21.15.50:0/2565383594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff08807e450 msgr2=0x7ff088089a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:20.543 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.536+0000 7ff08eea4700 1 --2- 172.21.15.50:0/2565383594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff08807e450 0x7ff088089a50 secure :-1 s=READY pgs=207 cs=0 l=1 rx=0x7ff078008790 tx=0x7ff07800fbf0).stop 2019-12-19T22:08:20.543 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.536+0000 7ff08eea4700 1 -- 172.21.15.50:0/2565383594 shutdown_connections 2019-12-19T22:08:20.543 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.536+0000 7ff08eea4700 1 --2- 172.21.15.50:0/2565383594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff08807e450 0x7ff088089a50 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:20.543 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.536+0000 7ff08eea4700 1 -- 172.21.15.50:0/2565383594 shutdown_connections 2019-12-19T22:08:20.543 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.536+0000 7ff08eea4700 1 -- 172.21.15.50:0/2565383594 wait complete. 2019-12-19T22:08:20.543 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.536+0000 7ff08eea4700 1 -- 172.21.15.50:0/2565383594 >> 172.21.15.50:0/2565383594 conn(0x7ff0880952d0 msgr2=0x7ff08808b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:20.544 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.537+0000 7ff08eea4700 1 Processor -- start 2019-12-19T22:08:20.544 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.537+0000 7ff08eea4700 1 -- start start 2019-12-19T22:08:20.547 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.538+0000 7ff08eea4700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff088092790 0x7ff088092bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:20.547 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.538+0000 7ff08eea4700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0880941d0 con 0x7ff088093110 2019-12-19T22:08:20.547 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.538+0000 7ff08eea4700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff088090960 con 0x7ff088092790 2019-12-19T22:08:20.547 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.538+0000 7ff08d441700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff088092790 0x7ff088092bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:20.547 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.538+0000 7ff08cc40700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff088093110 0x7ff088125a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39966/0 (socket says 172.21.15.50:39966) 2019-12-19T22:08:20.548 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.538+0000 7ff08d441700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff088092790 0x7ff088092bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53838/0 (socket says 172.21.15.50:53838) 2019-12-19T22:08:20.548 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.538+0000 7ff08cc40700 1 -- 172.21.15.50:0/3408081601 learned_addr learned my addr 172.21.15.50:0/3408081601 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:20.548 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.538+0000 7ff08d441700 1 -- 172.21.15.50:0/3408081601 >> v1:172.21.15.50:6789/0 conn(0x7ff088093110 legacy=0x7ff088125a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:20.548 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.538+0000 7ff07dffb700 1 -- 172.21.15.50:0/3408081601 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 337628866 0 0) 0x7ff0880941d0 con 0x7ff088093110 2019-12-19T22:08:20.548 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.538+0000 7ff08d441700 1 -- 172.21.15.50:0/3408081601 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff08807ba40 con 0x7ff088092790 2019-12-19T22:08:20.548 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.538+0000 7ff08d441700 1 --2- 172.21.15.50:0/3408081601 >> v2:172.21.15.50:3300/0 conn(0x7ff088092790 0x7ff088092bc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff088090840 tx=0x7ff084010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:20.549 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.538+0000 7ff08d441700 1 --2- 172.21.15.50:0/3408081601 >> v2:172.21.15.50:3300/0 conn(0x7ff088092790 0x7ff088092bc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff088090840 tx=0x7ff084010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:20.549 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.538+0000 7ff08d441700 1 --2- 172.21.15.50:0/3408081601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff088092790 0x7ff088092bc0 secure :-1 s=READY pgs=209 cs=0 l=1 rx=0x7ff088090840 tx=0x7ff084010820).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:20.549 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.538+0000 7ff08d441700 1 --2- 172.21.15.50:0/3408081601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff088092790 0x7ff088092bc0 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7ff088090840 tx=0x7ff084010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:20.549 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.538+0000 7ff07dffb700 1 -- 172.21.15.50:0/3408081601 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7ff084011480 con 0x7ff088092790 2019-12-19T22:08:20.549 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.538+0000 7ff08d441700 1 --2- 172.21.15.50:0/3408081601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff088092790 0x7ff088092bc0 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7ff088090840 tx=0x7ff084010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:20.549 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.538+0000 7ff08d441700 1 --2- 172.21.15.50:0/3408081601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff088092790 0x7ff088092bc0 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7ff088090840 tx=0x7ff084010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:20.549 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.538+0000 7ff07dffb700 1 -- 172.21.15.50:0/3408081601 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff084011680 con 0x7ff088092790 2019-12-19T22:08:20.550 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.538+0000 7ff08eea4700 1 -- 172.21.15.50:0/3408081601 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff088093540 con 0x7ff088092790 2019-12-19T22:08:20.550 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.538+0000 7ff07dffb700 1 -- 172.21.15.50:0/3408081601 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7ff0840119a0 con 0x7ff088092790 2019-12-19T22:08:20.550 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.538+0000 7ff08eea4700 1 -- 172.21.15.50:0/3408081601 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff08807d390 con 0x7ff088092790 2019-12-19T22:08:20.550 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.539+0000 7ff08d441700 1 --2- 172.21.15.50:0/3408081601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff088092790 0x7ff088092bc0 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7ff088090840 tx=0x7ff084010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:20.550 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.539+0000 7ff07dffb700 1 -- 172.21.15.50:0/3408081601 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7ff08400b330 con 0x7ff088092790 2019-12-19T22:08:20.550 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.539+0000 7ff08d441700 1 --2- 172.21.15.50:0/3408081601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff088092790 0x7ff088092bc0 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7ff088090840 tx=0x7ff084010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:20.551 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.539+0000 7ff07dffb700 1 --2- 172.21.15.50:0/3408081601 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7ff06801f9a0 0x7ff068021eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:20.551 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.539+0000 7ff07dffb700 1 -- 172.21.15.50:0/3408081601 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3786+0+0 (secure 0 0 0) 0x7ff08402a440 con 0x7ff088092790 2019-12-19T22:08:20.551 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.539+0000 7ff08cc40700 1 --2- 172.21.15.50:0/3408081601 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7ff06801f9a0 0x7ff068021eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:20.551 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.539+0000 7ff08eea4700 1 -- 172.21.15.50:0/3408081601 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff088056340 con 0x7ff088092790 2019-12-19T22:08:20.551 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.539+0000 7ff08cc40700 1 --2- 172.21.15.50:0/3408081601 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7ff06801f9a0 0x7ff068021eb0 crc :-1 s=READY pgs=51 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:20.551 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.543+0000 7ff08d441700 1 --2- 172.21.15.50:0/3408081601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff088092790 0x7ff088092bc0 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7ff088090840 tx=0x7ff084010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:20.552 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.543+0000 7ff07dffb700 1 -- 172.21.15.50:0/3408081601 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7ff08400b9c0 con 0x7ff088092790 2019-12-19T22:08:20.684 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:20.681+0000 7ff08eea4700 1 -- 172.21.15.50:0/3408081601 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "data_cache", "var": "hit_set_count", "val": "8"} v 0) v1 -- 0x7ff088093fa0 con 0x7ff088092790 2019-12-19T22:08:21.403 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.400+0000 7ff08d441700 1 --2- 172.21.15.50:0/3408081601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff088092790 0x7ff088092bc0 secure :-1 s=THROTTLE_DONE pgs=209 cs=0 l=1 rx=0x7ff088090840 tx=0x7ff084010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:21.403 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.400+0000 7ff07dffb700 1 -- 172.21.15.50:0/3408081601 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "data_cache", "var": "hit_set_count", "val": "8"}]=0 set pool 4 hit_set_count to 8 v23) v1 ==== 147+0+0 (secure 0 0 0) 0x7ff084011c10 con 0x7ff088092790 2019-12-19T22:08:21.405 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.403+0000 7ff08eea4700 1 -- 172.21.15.50:0/3408081601 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7ff06801f9a0 msgr2=0x7ff068021eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:21.405 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.403+0000 7ff08eea4700 1 --2- 172.21.15.50:0/3408081601 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7ff06801f9a0 0x7ff068021eb0 crc :-1 s=READY pgs=51 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:21.405 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.403+0000 7ff08eea4700 1 -- 172.21.15.50:0/3408081601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff088092790 msgr2=0x7ff088092bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:21.406 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.403+0000 7ff08eea4700 1 --2- 172.21.15.50:0/3408081601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff088092790 0x7ff088092bc0 secure :-1 s=READY pgs=209 cs=0 l=1 rx=0x7ff088090840 tx=0x7ff084010820).stop 2019-12-19T22:08:21.406 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.403+0000 7ff08eea4700 1 -- 172.21.15.50:0/3408081601 shutdown_connections 2019-12-19T22:08:21.406 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.403+0000 7ff08eea4700 1 --2- 172.21.15.50:0/3408081601 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7ff06801f9a0 0x7ff068021eb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:21.406 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.403+0000 7ff08eea4700 1 --2- 172.21.15.50:0/3408081601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff088092790 0x7ff088092bc0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:21.406 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.403+0000 7ff08eea4700 1 -- 172.21.15.50:0/3408081601 shutdown_connections 2019-12-19T22:08:21.406 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.403+0000 7ff08eea4700 1 -- 172.21.15.50:0/3408081601 wait complete. 2019-12-19T22:08:21.406 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.403+0000 7ff08eea4700 1 -- 172.21.15.50:0/3408081601 >> 172.21.15.50:0/3408081601 conn(0x7ff088091a70 msgr2=0x7ff08806d140 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:21.407 INFO:teuthology.orchestra.run.smithi050.stderr:set pool 4 hit_set_count to 8 2019-12-19T22:08:21.418 INFO:teuthology.orchestra.run.smithi050:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd pool set data_cache hit_set_period 3600' 2019-12-19T22:08:21.552 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.539+0000 7f6c46ca8700 1 Processor -- start 2019-12-19T22:08:21.553 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.539+0000 7f6c46ca8700 1 -- start start 2019-12-19T22:08:21.553 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.540+0000 7f6c46ca8700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6c4007e020 0x7f6c4007e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:21.553 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.540+0000 7f6c46ca8700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c4008f220 con 0x7f6c40089250 2019-12-19T22:08:21.554 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.540+0000 7f6c46ca8700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c4008f4f0 con 0x7f6c4007e020 2019-12-19T22:08:21.554 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.540+0000 7f6c45245700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6c4007e020 0x7f6c4007e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:21.554 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.540+0000 7f6c44a44700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6c40089250 0x7f6c40089680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39972/0 (socket says 172.21.15.50:39972) 2019-12-19T22:08:21.554 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.540+0000 7f6c44a44700 1 -- 172.21.15.50:0/2317005941 learned_addr learned my addr 172.21.15.50:0/2317005941 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:21.555 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.540+0000 7f6c45245700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6c4007e020 0x7f6c4007e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53844/0 (socket says 172.21.15.50:53844) 2019-12-19T22:08:21.555 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.540+0000 7f6c45245700 1 -- 172.21.15.50:0/2317005941 >> v1:172.21.15.50:6789/0 conn(0x7f6c40089250 legacy=0x7f6c40089680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:21.555 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.540+0000 7f6c37fff700 1 -- 172.21.15.50:0/2317005941 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3386827280 0 0) 0x7f6c4008f220 con 0x7f6c40089250 2019-12-19T22:08:21.555 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.540+0000 7f6c45245700 1 -- 172.21.15.50:0/2317005941 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4007dbb0 con 0x7f6c4007e020 2019-12-19T22:08:21.555 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.540+0000 7f6c45245700 1 --2- 172.21.15.50:0/2317005941 >> v2:172.21.15.50:3300/0 conn(0x7f6c4007e020 0x7f6c4007e450 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6c3c008790 tx=0x7f6c3c00fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:21.555 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.540+0000 7f6c45245700 1 --2- 172.21.15.50:0/2317005941 >> v2:172.21.15.50:3300/0 conn(0x7f6c4007e020 0x7f6c4007e450 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6c3c008790 tx=0x7f6c3c00fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:21.556 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.540+0000 7f6c45245700 1 --2- 172.21.15.50:0/2317005941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c4007e020 0x7f6c4007e450 secure :-1 s=READY pgs=211 cs=0 l=1 rx=0x7f6c3c008790 tx=0x7f6c3c00fbf0).ready entity=mon.0 client_cookie=2e783dde766b70c8 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:21.556 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.540+0000 7f6c45245700 1 --2- 172.21.15.50:0/2317005941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c4007e020 0x7f6c4007e450 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7f6c3c008790 tx=0x7f6c3c00fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:21.556 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.540+0000 7f6c37fff700 1 -- 172.21.15.50:0/2317005941 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f6c3c011270 con 0x7f6c4007e020 2019-12-19T22:08:21.556 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.540+0000 7f6c45245700 1 --2- 172.21.15.50:0/2317005941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c4007e020 0x7f6c4007e450 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7f6c3c008790 tx=0x7f6c3c00fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:21.557 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.540+0000 7f6c37fff700 1 -- 172.21.15.50:0/2317005941 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c3c011470 con 0x7f6c4007e020 2019-12-19T22:08:21.557 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.540+0000 7f6c45245700 1 --2- 172.21.15.50:0/2317005941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c4007e020 0x7f6c4007e450 secure :-1 s=THROTTLE_DONE pgs=211 cs=0 l=1 rx=0x7f6c3c008790 tx=0x7f6c3c00fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:21.557 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.541+0000 7f6c37fff700 1 -- 172.21.15.50:0/2317005941 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f6c3c011790 con 0x7f6c4007e020 2019-12-19T22:08:21.557 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.541+0000 7f6c46ca8700 1 -- 172.21.15.50:0/2317005941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c4007e020 msgr2=0x7f6c4007e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:21.558 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.541+0000 7f6c46ca8700 1 --2- 172.21.15.50:0/2317005941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c4007e020 0x7f6c4007e450 secure :-1 s=READY pgs=211 cs=0 l=1 rx=0x7f6c3c008790 tx=0x7f6c3c00fbf0).stop 2019-12-19T22:08:21.558 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.541+0000 7f6c46ca8700 1 -- 172.21.15.50:0/2317005941 shutdown_connections 2019-12-19T22:08:21.559 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.541+0000 7f6c46ca8700 1 --2- 172.21.15.50:0/2317005941 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c4007e020 0x7f6c4007e450 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:21.559 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.541+0000 7f6c46ca8700 1 -- 172.21.15.50:0/2317005941 shutdown_connections 2019-12-19T22:08:21.559 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.541+0000 7f6c46ca8700 1 -- 172.21.15.50:0/2317005941 wait complete. 2019-12-19T22:08:21.559 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.541+0000 7f6c46ca8700 1 -- 172.21.15.50:0/2317005941 >> 172.21.15.50:0/2317005941 conn(0x7f6c400952d0 msgr2=0x7f6c4008b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:21.560 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.542+0000 7f6c46ca8700 1 Processor -- start 2019-12-19T22:08:21.562 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.542+0000 7f6c46ca8700 1 -- start start 2019-12-19T22:08:21.568 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.543+0000 7f6c46ca8700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6c40081700 0x7f6c40070d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:21.568 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.543+0000 7f6c46ca8700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c400812a0 con 0x7f6c4007ec20 2019-12-19T22:08:21.569 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.543+0000 7f6c46ca8700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c4007d390 con 0x7f6c40081700 2019-12-19T22:08:21.571 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.543+0000 7f6c45245700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6c40081700 0x7f6c40070d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:21.571 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.543+0000 7f6c45245700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6c40081700 0x7f6c40070d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53848/0 (socket says 172.21.15.50:53848) 2019-12-19T22:08:21.572 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.543+0000 7f6c45245700 1 -- 172.21.15.50:0/45221554 learned_addr learned my addr 172.21.15.50:0/45221554 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:21.573 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.543+0000 7f6c45245700 1 -- 172.21.15.50:0/45221554 >> v1:172.21.15.50:6789/0 conn(0x7f6c4007ec20 legacy=0x7f6c4007f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:21.573 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.543+0000 7f6c35ffb700 1 -- 172.21.15.50:0/45221554 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1609936036 0 0) 0x7f6c400812a0 con 0x7f6c4007ec20 2019-12-19T22:08:21.573 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.543+0000 7f6c45245700 1 -- 172.21.15.50:0/45221554 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c400806d0 con 0x7f6c40081700 2019-12-19T22:08:21.573 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.543+0000 7f6c45245700 1 --2- 172.21.15.50:0/45221554 >> v2:172.21.15.50:3300/0 conn(0x7f6c40081700 0x7f6c40070d00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6c3c008790 tx=0x7f6c3c00f490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:21.574 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.543+0000 7f6c45245700 1 --2- 172.21.15.50:0/45221554 >> v2:172.21.15.50:3300/0 conn(0x7f6c40081700 0x7f6c40070d00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6c3c008790 tx=0x7f6c3c00f490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:21.574 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.543+0000 7f6c45245700 1 --2- 172.21.15.50:0/45221554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c40081700 0x7f6c40070d00 secure :-1 s=READY pgs=213 cs=0 l=1 rx=0x7f6c3c008790 tx=0x7f6c3c00f490).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:21.574 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.543+0000 7f6c45245700 1 --2- 172.21.15.50:0/45221554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c40081700 0x7f6c40070d00 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7f6c3c008790 tx=0x7f6c3c00f490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:21.574 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.543+0000 7f6c35ffb700 1 -- 172.21.15.50:0/45221554 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f6c3c007280 con 0x7f6c40081700 2019-12-19T22:08:21.575 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.543+0000 7f6c45245700 1 --2- 172.21.15.50:0/45221554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c40081700 0x7f6c40070d00 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7f6c3c008790 tx=0x7f6c3c00f490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:21.575 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.543+0000 7f6c45245700 1 --2- 172.21.15.50:0/45221554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c40081700 0x7f6c40070d00 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7f6c3c008790 tx=0x7f6c3c00f490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:21.575 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.543+0000 7f6c35ffb700 1 -- 172.21.15.50:0/45221554 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c3c011480 con 0x7f6c40081700 2019-12-19T22:08:21.575 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.543+0000 7f6c46ca8700 1 -- 172.21.15.50:0/45221554 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c4007ca00 con 0x7f6c40081700 2019-12-19T22:08:21.575 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.543+0000 7f6c35ffb700 1 -- 172.21.15.50:0/45221554 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f6c3c0117a0 con 0x7f6c40081700 2019-12-19T22:08:21.576 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.543+0000 7f6c46ca8700 1 -- 172.21.15.50:0/45221554 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c400801f0 con 0x7f6c40081700 2019-12-19T22:08:21.576 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.544+0000 7f6c45245700 1 --2- 172.21.15.50:0/45221554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c40081700 0x7f6c40070d00 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7f6c3c008790 tx=0x7f6c3c00f490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:21.576 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.544+0000 7f6c35ffb700 1 -- 172.21.15.50:0/45221554 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7f6c3c005540 con 0x7f6c40081700 2019-12-19T22:08:21.576 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.544+0000 7f6c45245700 1 --2- 172.21.15.50:0/45221554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c40081700 0x7f6c40070d00 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7f6c3c008790 tx=0x7f6c3c00f490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:21.577 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.544+0000 7f6c35ffb700 1 --2- 172.21.15.50:0/45221554 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f6c2001f970 0x7f6c20021e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:21.577 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.544+0000 7f6c35ffb700 1 -- 172.21.15.50:0/45221554 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3786+0+0 (secure 0 0 0) 0x7f6c3c02acb0 con 0x7f6c40081700 2019-12-19T22:08:21.578 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.544+0000 7f6c44a44700 1 --2- 172.21.15.50:0/45221554 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f6c2001f970 0x7f6c20021e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:21.578 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.544+0000 7f6c44a44700 1 --2- 172.21.15.50:0/45221554 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f6c2001f970 0x7f6c20021e80 crc :-1 s=READY pgs=52 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:21.578 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.544+0000 7f6c46ca8700 1 -- 172.21.15.50:0/45221554 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c40056340 con 0x7f6c40081700 2019-12-19T22:08:21.579 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.548+0000 7f6c45245700 1 --2- 172.21.15.50:0/45221554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c40081700 0x7f6c40070d00 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7f6c3c008790 tx=0x7f6c3c00f490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:21.579 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.548+0000 7f6c35ffb700 1 -- 172.21.15.50:0/45221554 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7f6c3c005dc0 con 0x7f6c40081700 2019-12-19T22:08:21.689 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:21.685+0000 7f6c46ca8700 1 -- 172.21.15.50:0/45221554 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "data_cache", "var": "hit_set_period", "val": "3600"} v 0) v1 -- 0x7f6c4006a140 con 0x7f6c40081700 2019-12-19T22:08:22.405 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.402+0000 7f6c45245700 1 --2- 172.21.15.50:0/45221554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c40081700 0x7f6c40070d00 secure :-1 s=THROTTLE_DONE pgs=213 cs=0 l=1 rx=0x7f6c3c008790 tx=0x7f6c3c00f490).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:22.405 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.402+0000 7f6c35ffb700 1 -- 172.21.15.50:0/45221554 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "data_cache", "var": "hit_set_period", "val": "3600"}]=0 set pool 4 hit_set_period to 3600 v24) v1 ==== 155+0+0 (secure 0 0 0) 0x7f6c3c0058a0 con 0x7f6c40081700 2019-12-19T22:08:22.408 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.405+0000 7f6c46ca8700 1 -- 172.21.15.50:0/45221554 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f6c2001f970 msgr2=0x7f6c20021e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:22.408 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.405+0000 7f6c46ca8700 1 --2- 172.21.15.50:0/45221554 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f6c2001f970 0x7f6c20021e80 crc :-1 s=READY pgs=52 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:22.409 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.405+0000 7f6c46ca8700 1 -- 172.21.15.50:0/45221554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c40081700 msgr2=0x7f6c40070d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:22.409 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.405+0000 7f6c46ca8700 1 --2- 172.21.15.50:0/45221554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c40081700 0x7f6c40070d00 secure :-1 s=READY pgs=213 cs=0 l=1 rx=0x7f6c3c008790 tx=0x7f6c3c00f490).stop 2019-12-19T22:08:22.409 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.405+0000 7f6c46ca8700 1 -- 172.21.15.50:0/45221554 shutdown_connections 2019-12-19T22:08:22.409 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.405+0000 7f6c46ca8700 1 --2- 172.21.15.50:0/45221554 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f6c2001f970 0x7f6c20021e80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:22.409 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.405+0000 7f6c46ca8700 1 --2- 172.21.15.50:0/45221554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c40081700 0x7f6c40070d00 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:22.410 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.405+0000 7f6c46ca8700 1 -- 172.21.15.50:0/45221554 shutdown_connections 2019-12-19T22:08:22.410 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.405+0000 7f6c46ca8700 1 -- 172.21.15.50:0/45221554 wait complete. 2019-12-19T22:08:22.410 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.405+0000 7f6c46ca8700 1 -- 172.21.15.50:0/45221554 >> 172.21.15.50:0/45221554 conn(0x7f6c40091930 msgr2=0x7f6c4008bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:22.410 INFO:teuthology.orchestra.run.smithi050.stderr:set pool 4 hit_set_period to 3600 2019-12-19T22:08:22.427 INFO:teuthology.orchestra.run.smithi050:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd pool set data_cache min_read_recency_for_promote 0' 2019-12-19T22:08:22.554 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.549+0000 7f3884a7e700 1 Processor -- start 2019-12-19T22:08:22.555 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.549+0000 7f3884a7e700 1 -- start start 2019-12-19T22:08:22.555 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.550+0000 7f3884a7e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f388007e450 0x7f3880089a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:22.555 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.550+0000 7f3884a7e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f388008f220 con 0x7f388007e020 2019-12-19T22:08:22.555 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.550+0000 7f3884a7e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f388008f4f0 con 0x7f388007e450 2019-12-19T22:08:22.555 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.550+0000 7f387e59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f388007e450 0x7f3880089a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:22.555 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.550+0000 7f387e59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f388007e450 0x7f3880089a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53856/0 (socket says 172.21.15.50:53856) 2019-12-19T22:08:22.556 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.550+0000 7f387ed9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f388007e020 0x7f3880089250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39982/0 (socket says 172.21.15.50:39982) 2019-12-19T22:08:22.556 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.550+0000 7f387e59c700 1 -- 172.21.15.50:0/744079077 learned_addr learned my addr 172.21.15.50:0/744079077 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:22.556 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.550+0000 7f387e59c700 1 -- 172.21.15.50:0/744079077 >> v1:172.21.15.50:6789/0 conn(0x7f388007e020 legacy=0x7f3880089250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:22.556 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.550+0000 7f387e59c700 1 -- 172.21.15.50:0/744079077 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f388007dbb0 con 0x7f388007e450 2019-12-19T22:08:22.556 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.550+0000 7f387e59c700 1 --2- 172.21.15.50:0/744079077 >> v2:172.21.15.50:3300/0 conn(0x7f388007e450 0x7f3880089a50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3874008790 tx=0x7f387400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:22.556 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.550+0000 7f387e59c700 1 --2- 172.21.15.50:0/744079077 >> v2:172.21.15.50:3300/0 conn(0x7f388007e450 0x7f3880089a50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3874008790 tx=0x7f387400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:22.556 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.550+0000 7f387e59c700 1 --2- 172.21.15.50:0/744079077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f388007e450 0x7f3880089a50 secure :-1 s=READY pgs=215 cs=0 l=1 rx=0x7f3874008790 tx=0x7f387400fcb0).ready entity=mon.0 client_cookie=f56fac5f97807fff server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:22.557 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.550+0000 7f387e59c700 1 --2- 172.21.15.50:0/744079077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f388007e450 0x7f3880089a50 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7f3874008790 tx=0x7f387400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:22.557 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.550+0000 7f387dd9b700 1 -- 172.21.15.50:0/744079077 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f3874011330 con 0x7f388007e450 2019-12-19T22:08:22.557 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.551+0000 7f387e59c700 1 --2- 172.21.15.50:0/744079077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f388007e450 0x7f3880089a50 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7f3874008790 tx=0x7f387400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:22.557 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.551+0000 7f387e59c700 1 --2- 172.21.15.50:0/744079077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f388007e450 0x7f3880089a50 secure :-1 s=THROTTLE_DONE pgs=215 cs=0 l=1 rx=0x7f3874008790 tx=0x7f387400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:22.559 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.551+0000 7f387dd9b700 1 -- 172.21.15.50:0/744079077 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3874011530 con 0x7f388007e450 2019-12-19T22:08:22.559 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.551+0000 7f387dd9b700 1 -- 172.21.15.50:0/744079077 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f3874011850 con 0x7f388007e450 2019-12-19T22:08:22.560 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.551+0000 7f3884a7e700 1 -- 172.21.15.50:0/744079077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f388007e450 msgr2=0x7f3880089a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:22.560 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.551+0000 7f3884a7e700 1 --2- 172.21.15.50:0/744079077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f388007e450 0x7f3880089a50 secure :-1 s=READY pgs=215 cs=0 l=1 rx=0x7f3874008790 tx=0x7f387400fcb0).stop 2019-12-19T22:08:22.560 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.551+0000 7f3884a7e700 1 -- 172.21.15.50:0/744079077 shutdown_connections 2019-12-19T22:08:22.560 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.551+0000 7f3884a7e700 1 --2- 172.21.15.50:0/744079077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f388007e450 0x7f3880089a50 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:22.560 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.551+0000 7f3884a7e700 1 -- 172.21.15.50:0/744079077 shutdown_connections 2019-12-19T22:08:22.560 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.551+0000 7f3884a7e700 1 -- 172.21.15.50:0/744079077 wait complete. 2019-12-19T22:08:22.561 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.551+0000 7f3884a7e700 1 -- 172.21.15.50:0/744079077 >> 172.21.15.50:0/744079077 conn(0x7f38800952d0 msgr2=0x7f388008b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:22.561 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.552+0000 7f3884a7e700 1 Processor -- start 2019-12-19T22:08:22.561 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.552+0000 7f3884a7e700 1 -- start start 2019-12-19T22:08:22.564 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.552+0000 7f3884a7e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3880124a60 0x7f3880126ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:22.564 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.553+0000 7f3884a7e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f388008a030 con 0x7f38800865f0 2019-12-19T22:08:22.564 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.553+0000 7f3884a7e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3880090980 con 0x7f3880124a60 2019-12-19T22:08:22.564 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.553+0000 7f387e59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3880124a60 0x7f3880126ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:22.564 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.553+0000 7f387e59c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f3880124a60 0x7f3880126ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53860/0 (socket says 172.21.15.50:53860) 2019-12-19T22:08:22.564 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.553+0000 7f387e59c700 1 -- 172.21.15.50:0/737687825 learned_addr learned my addr 172.21.15.50:0/737687825 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:22.564 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.553+0000 7f387e59c700 1 -- 172.21.15.50:0/737687825 >> v1:172.21.15.50:6789/0 conn(0x7f38800865f0 legacy=0x7f3880086a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:22.565 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.553+0000 7f387e59c700 1 -- 172.21.15.50:0/737687825 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3880088a00 con 0x7f3880124a60 2019-12-19T22:08:22.565 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.553+0000 7f387e59c700 1 --2- 172.21.15.50:0/737687825 >> v2:172.21.15.50:3300/0 conn(0x7f3880124a60 0x7f3880126ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3874008790 tx=0x7f387400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:22.565 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.553+0000 7f387e59c700 1 --2- 172.21.15.50:0/737687825 >> v2:172.21.15.50:3300/0 conn(0x7f3880124a60 0x7f3880126ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3874008790 tx=0x7f387400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:22.565 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.553+0000 7f387e59c700 1 --2- 172.21.15.50:0/737687825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3880124a60 0x7f3880126ea0 secure :-1 s=READY pgs=217 cs=0 l=1 rx=0x7f3874008790 tx=0x7f387400f780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:22.565 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.553+0000 7f387e59c700 1 --2- 172.21.15.50:0/737687825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3880124a60 0x7f3880126ea0 secure :-1 s=THROTTLE_DONE pgs=217 cs=0 l=1 rx=0x7f3874008790 tx=0x7f387400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:22.565 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.553+0000 7f386f7fe700 1 -- 172.21.15.50:0/737687825 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f3874007280 con 0x7f3880124a60 2019-12-19T22:08:22.566 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.553+0000 7f387e59c700 1 --2- 172.21.15.50:0/737687825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3880124a60 0x7f3880126ea0 secure :-1 s=THROTTLE_DONE pgs=217 cs=0 l=1 rx=0x7f3874008790 tx=0x7f387400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:22.566 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.553+0000 7f387e59c700 1 --2- 172.21.15.50:0/737687825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3880124a60 0x7f3880126ea0 secure :-1 s=THROTTLE_DONE pgs=217 cs=0 l=1 rx=0x7f3874008790 tx=0x7f387400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:22.566 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.553+0000 7f386f7fe700 1 -- 172.21.15.50:0/737687825 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3874007480 con 0x7f3880124a60 2019-12-19T22:08:22.566 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.553+0000 7f386f7fe700 1 -- 172.21.15.50:0/737687825 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f3874011670 con 0x7f3880124a60 2019-12-19T22:08:22.566 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.553+0000 7f3884a7e700 1 -- 172.21.15.50:0/737687825 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38800877c0 con 0x7f3880124a60 2019-12-19T22:08:22.566 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.553+0000 7f3884a7e700 1 -- 172.21.15.50:0/737687825 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3880087220 con 0x7f3880124a60 2019-12-19T22:08:22.566 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.554+0000 7f387e59c700 1 --2- 172.21.15.50:0/737687825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3880124a60 0x7f3880126ea0 secure :-1 s=THROTTLE_DONE pgs=217 cs=0 l=1 rx=0x7f3874008790 tx=0x7f387400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:22.568 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.554+0000 7f386f7fe700 1 -- 172.21.15.50:0/737687825 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7f3874005540 con 0x7f3880124a60 2019-12-19T22:08:22.568 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.554+0000 7f387e59c700 1 --2- 172.21.15.50:0/737687825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3880124a60 0x7f3880126ea0 secure :-1 s=THROTTLE_DONE pgs=217 cs=0 l=1 rx=0x7f3874008790 tx=0x7f387400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:22.568 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.554+0000 7f386f7fe700 1 --2- 172.21.15.50:0/737687825 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f386401fa60 0x7f3864021f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:22.568 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.554+0000 7f386f7fe700 1 -- 172.21.15.50:0/737687825 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 3786+0+0 (secure 0 0 0) 0x7f387402aa30 con 0x7f3880124a60 2019-12-19T22:08:22.568 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.554+0000 7f387ed9d700 1 --2- 172.21.15.50:0/737687825 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f386401fa60 0x7f3864021f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:22.569 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.554+0000 7f387ed9d700 1 --2- 172.21.15.50:0/737687825 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f386401fa60 0x7f3864021f70 crc :-1 s=READY pgs=53 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:22.569 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.555+0000 7f3884a7e700 1 -- 172.21.15.50:0/737687825 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3880056340 con 0x7f3880124a60 2019-12-19T22:08:22.569 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.558+0000 7f387e59c700 1 --2- 172.21.15.50:0/737687825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3880124a60 0x7f3880126ea0 secure :-1 s=THROTTLE_DONE pgs=217 cs=0 l=1 rx=0x7f3874008790 tx=0x7f387400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:22.569 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.558+0000 7f386f7fe700 1 -- 172.21.15.50:0/737687825 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7f387402a510 con 0x7f3880124a60 2019-12-19T22:08:22.700 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:22.698+0000 7f3884a7e700 1 -- 172.21.15.50:0/737687825 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "data_cache", "var": "min_read_recency_for_promote", "val": "0"} v 0) v1 -- 0x7f3880081fd0 con 0x7f3880124a60 2019-12-19T22:08:23.406 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.404+0000 7f387e59c700 1 --2- 172.21.15.50:0/737687825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3880124a60 0x7f3880126ea0 secure :-1 s=THROTTLE_DONE pgs=217 cs=0 l=1 rx=0x7f3874008790 tx=0x7f387400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:23.406 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.404+0000 7f386f7fe700 1 -- 172.21.15.50:0/737687825 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "data_cache", "var": "min_read_recency_for_promote", "val": "0"}]=0 set pool 4 min_read_recency_for_promote to 0 v25) v1 ==== 177+0+0 (secure 0 0 0) 0x7f38740097c0 con 0x7f3880124a60 2019-12-19T22:08:23.408 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.406+0000 7f3884a7e700 1 -- 172.21.15.50:0/737687825 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f386401fa60 msgr2=0x7f3864021f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:23.409 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.406+0000 7f3884a7e700 1 --2- 172.21.15.50:0/737687825 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f386401fa60 0x7f3864021f70 crc :-1 s=READY pgs=53 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:23.409 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.406+0000 7f3884a7e700 1 -- 172.21.15.50:0/737687825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3880124a60 msgr2=0x7f3880126ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:23.409 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.406+0000 7f3884a7e700 1 --2- 172.21.15.50:0/737687825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3880124a60 0x7f3880126ea0 secure :-1 s=READY pgs=217 cs=0 l=1 rx=0x7f3874008790 tx=0x7f387400f780).stop 2019-12-19T22:08:23.409 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.406+0000 7f3884a7e700 1 -- 172.21.15.50:0/737687825 shutdown_connections 2019-12-19T22:08:23.409 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.406+0000 7f3884a7e700 1 --2- 172.21.15.50:0/737687825 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f386401fa60 0x7f3864021f70 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:23.410 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.406+0000 7f3884a7e700 1 --2- 172.21.15.50:0/737687825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3880124a60 0x7f3880126ea0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:23.410 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.406+0000 7f3884a7e700 1 -- 172.21.15.50:0/737687825 shutdown_connections 2019-12-19T22:08:23.410 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.406+0000 7f3884a7e700 1 -- 172.21.15.50:0/737687825 wait complete. 2019-12-19T22:08:23.410 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.406+0000 7f3884a7e700 1 -- 172.21.15.50:0/737687825 >> 172.21.15.50:0/737687825 conn(0x7f388008d8c0 msgr2=0x7f388008bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:23.411 INFO:teuthology.orchestra.run.smithi050.stderr:set pool 4 min_read_recency_for_promote to 0 2019-12-19T22:08:23.421 INFO:teuthology.run_tasks:Running task ceph-fuse... 2019-12-19T22:08:23.470 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2019-12-19T22:08:23.470 INFO:tasks.ceph_fuse:config is None 2019-12-19T22:08:23.471 INFO:tasks.ceph_fuse:new config is {'client.1': None, 'client.0': None} 2019-12-19T22:08:23.471 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2019-12-19T22:08:23.471 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-12-19T22:08:23.614 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.604+0000 7f7780138700 1 Processor -- start 2019-12-19T22:08:23.615 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.604+0000 7f7780138700 1 -- start start 2019-12-19T22:08:23.615 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.605+0000 7f7780138700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f77780898b0 0x7f7778081170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:23.615 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.605+0000 7f7780138700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7778089ce0 con 0x7f7778089480 2019-12-19T22:08:23.615 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.605+0000 7f7780138700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f777808ae60 con 0x7f77780898b0 2019-12-19T22:08:23.616 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.605+0000 7f777ded4700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f77780898b0 0x7f7778081170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:23.616 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.605+0000 7f777e6d5700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7778089480 0x7f777808f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:39992/0 (socket says 172.21.15.50:39992) 2019-12-19T22:08:23.616 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.605+0000 7f777e6d5700 1 -- 172.21.15.50:0/1732965623 learned_addr learned my addr 172.21.15.50:0/1732965623 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:23.616 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.605+0000 7f777ded4700 1 -- 172.21.15.50:0/1732965623 >> v1:172.21.15.50:6789/0 conn(0x7f7778089480 legacy=0x7f777808f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:23.617 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.605+0000 7f777ded4700 1 -- 172.21.15.50:0/1732965623 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f777808edb0 con 0x7f77780898b0 2019-12-19T22:08:23.617 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.605+0000 7f777ded4700 1 --2- 172.21.15.50:0/1732965623 >> v2:172.21.15.50:3300/0 conn(0x7f77780898b0 0x7f7778081170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f776c008790 tx=0x7f776c00fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:23.617 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.606+0000 7f777ded4700 1 --2- 172.21.15.50:0/1732965623 >> v2:172.21.15.50:3300/0 conn(0x7f77780898b0 0x7f7778081170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f776c008790 tx=0x7f776c00fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:23.617 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.606+0000 7f777ded4700 1 --2- 172.21.15.50:0/1732965623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77780898b0 0x7f7778081170 secure :-1 s=READY pgs=219 cs=0 l=1 rx=0x7f776c008790 tx=0x7f776c00fbf0).ready entity=mon.0 client_cookie=b4bdd14a60fa659f server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:23.618 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.606+0000 7f777ded4700 1 --2- 172.21.15.50:0/1732965623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77780898b0 0x7f7778081170 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7f776c008790 tx=0x7f776c00fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:23.618 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.606+0000 7f777ded4700 1 --2- 172.21.15.50:0/1732965623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77780898b0 0x7f7778081170 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7f776c008790 tx=0x7f776c00fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:23.618 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.606+0000 7f777d6d3700 1 -- 172.21.15.50:0/1732965623 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f776c011270 con 0x7f77780898b0 2019-12-19T22:08:23.618 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.606+0000 7f777ded4700 1 --2- 172.21.15.50:0/1732965623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77780898b0 0x7f7778081170 secure :-1 s=THROTTLE_DONE pgs=219 cs=0 l=1 rx=0x7f776c008790 tx=0x7f776c00fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:23.619 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.606+0000 7f777d6d3700 1 -- 172.21.15.50:0/1732965623 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f776c011470 con 0x7f77780898b0 2019-12-19T22:08:23.619 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.606+0000 7f777d6d3700 1 -- 172.21.15.50:0/1732965623 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f776c0117d0 con 0x7f77780898b0 2019-12-19T22:08:23.619 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.606+0000 7f7780138700 1 -- 172.21.15.50:0/1732965623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77780898b0 msgr2=0x7f7778081170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:23.619 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.606+0000 7f7780138700 1 --2- 172.21.15.50:0/1732965623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77780898b0 0x7f7778081170 secure :-1 s=READY pgs=219 cs=0 l=1 rx=0x7f776c008790 tx=0x7f776c00fbf0).stop 2019-12-19T22:08:23.620 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.606+0000 7f7780138700 1 -- 172.21.15.50:0/1732965623 shutdown_connections 2019-12-19T22:08:23.620 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.606+0000 7f7780138700 1 --2- 172.21.15.50:0/1732965623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77780898b0 0x7f7778081170 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:23.620 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.606+0000 7f7780138700 1 -- 172.21.15.50:0/1732965623 shutdown_connections 2019-12-19T22:08:23.628 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.606+0000 7f7780138700 1 -- 172.21.15.50:0/1732965623 wait complete. 2019-12-19T22:08:23.628 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.606+0000 7f7780138700 1 -- 172.21.15.50:0/1732965623 >> 172.21.15.50:0/1732965623 conn(0x7f7778067e70 msgr2=0x7f7778094570 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:23.628 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.607+0000 7f7780138700 1 Processor -- start 2019-12-19T22:08:23.629 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.607+0000 7f7780138700 1 -- start start 2019-12-19T22:08:23.629 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.608+0000 7f7780138700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7778090040 0x7f7778090470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:23.629 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.608+0000 7f7780138700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7778090df0 con 0x7f77780909c0 2019-12-19T22:08:23.629 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.608+0000 7f7780138700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77780841a0 con 0x7f7778090040 2019-12-19T22:08:23.631 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.608+0000 7f777e6d5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7778090040 0x7f7778090470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:23.631 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.608+0000 7f777e6d5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7778090040 0x7f7778090470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53866/0 (socket says 172.21.15.50:53866) 2019-12-19T22:08:23.631 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.608+0000 7f777e6d5700 1 -- 172.21.15.50:0/829357234 learned_addr learned my addr 172.21.15.50:0/829357234 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:23.631 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.608+0000 7f777e6d5700 1 -- 172.21.15.50:0/829357234 >> v1:172.21.15.50:6789/0 conn(0x7f77780909c0 legacy=0x7f7778079fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:23.632 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.608+0000 7f777e6d5700 1 -- 172.21.15.50:0/829357234 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7778082200 con 0x7f7778090040 2019-12-19T22:08:23.632 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.608+0000 7f777e6d5700 1 --2- 172.21.15.50:0/829357234 >> v2:172.21.15.50:3300/0 conn(0x7f7778090040 0x7f7778090470 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f77740043a0 tx=0x7f777400c400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:23.632 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.608+0000 7f777e6d5700 1 --2- 172.21.15.50:0/829357234 >> v2:172.21.15.50:3300/0 conn(0x7f7778090040 0x7f7778090470 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f77740043a0 tx=0x7f777400c400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:23.640 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.608+0000 7f777e6d5700 1 --2- 172.21.15.50:0/829357234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7778090040 0x7f7778090470 secure :-1 s=READY pgs=221 cs=0 l=1 rx=0x7f77740043a0 tx=0x7f777400c400).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:23.640 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.608+0000 7f777e6d5700 1 --2- 172.21.15.50:0/829357234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7778090040 0x7f7778090470 secure :-1 s=THROTTLE_DONE pgs=221 cs=0 l=1 rx=0x7f77740043a0 tx=0x7f777400c400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:23.640 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.608+0000 7f777e6d5700 1 --2- 172.21.15.50:0/829357234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7778090040 0x7f7778090470 secure :-1 s=THROTTLE_DONE pgs=221 cs=0 l=1 rx=0x7f77740043a0 tx=0x7f777400c400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:23.641 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.608+0000 7f776affd700 1 -- 172.21.15.50:0/829357234 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f77740115a0 con 0x7f7778090040 2019-12-19T22:08:23.641 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.608+0000 7f777e6d5700 1 --2- 172.21.15.50:0/829357234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7778090040 0x7f7778090470 secure :-1 s=THROTTLE_DONE pgs=221 cs=0 l=1 rx=0x7f77740043a0 tx=0x7f777400c400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:23.641 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.608+0000 7f776affd700 1 -- 172.21.15.50:0/829357234 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77740117a0 con 0x7f7778090040 2019-12-19T22:08:23.641 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.608+0000 7f7780138700 1 -- 172.21.15.50:0/829357234 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f777807b080 con 0x7f7778090040 2019-12-19T22:08:23.641 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.608+0000 7f776affd700 1 -- 172.21.15.50:0/829357234 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f7774011b00 con 0x7f7778090040 2019-12-19T22:08:23.641 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.608+0000 7f7780138700 1 -- 172.21.15.50:0/829357234 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f777805f790 con 0x7f7778090040 2019-12-19T22:08:23.641 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.609+0000 7f777e6d5700 1 --2- 172.21.15.50:0/829357234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7778090040 0x7f7778090470 secure :-1 s=THROTTLE_DONE pgs=221 cs=0 l=1 rx=0x7f77740043a0 tx=0x7f777400c400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:23.642 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.609+0000 7f776affd700 1 -- 172.21.15.50:0/829357234 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7f7774007180 con 0x7f7778090040 2019-12-19T22:08:23.642 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.609+0000 7f777e6d5700 1 --2- 172.21.15.50:0/829357234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7778090040 0x7f7778090470 secure :-1 s=THROTTLE_DONE pgs=221 cs=0 l=1 rx=0x7f77740043a0 tx=0x7f777400c400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:23.642 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.609+0000 7f776affd700 1 --2- 172.21.15.50:0/829357234 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f776001fa80 0x7f7760021f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:23.642 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.609+0000 7f776affd700 1 -- 172.21.15.50:0/829357234 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3786+0+0 (secure 0 0 0) 0x7f7774029ee0 con 0x7f7778090040 2019-12-19T22:08:23.642 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.609+0000 7f777ded4700 1 --2- 172.21.15.50:0/829357234 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f776001fa80 0x7f7760021f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:23.642 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.609+0000 7f777ded4700 1 --2- 172.21.15.50:0/829357234 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f776001fa80 0x7f7760021f90 crc :-1 s=READY pgs=54 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:23.642 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.610+0000 7f7780138700 1 -- 172.21.15.50:0/829357234 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7778056340 con 0x7f7778090040 2019-12-19T22:08:23.643 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.613+0000 7f777e6d5700 1 --2- 172.21.15.50:0/829357234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7778090040 0x7f7778090470 secure :-1 s=THROTTLE_DONE pgs=221 cs=0 l=1 rx=0x7f77740043a0 tx=0x7f777400c400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:23.643 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.613+0000 7f776affd700 1 -- 172.21.15.50:0/829357234 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7f7774046e90 con 0x7f7778090040 2019-12-19T22:08:23.754 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.751+0000 7f7780138700 1 -- 172.21.15.50:0/829357234 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7778083900 con 0x7f7778090040 2019-12-19T22:08:23.754 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.752+0000 7f777e6d5700 1 --2- 172.21.15.50:0/829357234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7778090040 0x7f7778090470 secure :-1 s=THROTTLE_DONE pgs=221 cs=0 l=1 rx=0x7f77740043a0 tx=0x7f777400c400).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:23.754 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.752+0000 7f776affd700 1 -- 172.21.15.50:0/829357234 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+10340 (secure 0 0 0) 0x7f7774007810 con 0x7f7778090040 2019-12-19T22:08:23.755 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:08:23.755 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"c1382993-41cc-4b35-a402-c17778701f01","created":"2019-12-19T22:07:52.345475+0000","modified":"2019-12-19T22:08:23.402450+0000","last_up_change":"2019-12-19T22:07:58.357117+0000","last_in_change":"2019-12-19T22:07:58.357117+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-19T22:08:01.570202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2019-12-19T22:08:04.515784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2019-12-19T22:08:05.689151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"21","last_force_op_resend_prenautilus":"21","last_force_op_resend_preluminous":"21","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[4],"tier_of":-1,"read_tier":4,"write_tier":4,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"data_cache","create_time":"2019-12-19T22:08:16.355664+0000","flags":9,"flags_names":"hashpspool,incomplete_clones","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":4,"pg_placement_num":4,"pg_placement_num_target":4,"pg_num_target":4,"pg_num_pending":4,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"21","last_force_op_resend_prenautilus":"21","last_force_op_resend_preluminous":"21","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":3,"read_tier":-1,"write_tier":-1,"cache_mode":"writeback","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"bloom","false_positive_probability":0.050000000000000003,"target_size":0,"seed":0},"hit_set_period":3600,"hit_set_count":8,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{}}],"osds":[{"osd":0,"uuid":"6137ed8c-8e2c-4e88-8634-dc763bed14c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":27757},{"type":"v1","addr":"172.21.15.50:6817","nonce":27757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":27757},{"type":"v1","addr":"172.21.15.50:6819","nonce":27757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":27757},{"type":"v1","addr":"172.21.15.50:6823","nonce":27757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":27757},{"type":"v1","addr":"172.21.15.50:6821","nonce":27757}]},"public_addr":"172.21.15.50:6817/27757","cluster_addr":"172.21.15.50:6819/27757","heartbeat_back_addr":"172.21.15.50:6823/27757","heartbeat_front_addr":"172.21.15.50:6821/27757","state":["exists","up"]},{"osd":1,"uuid":"57d4e31d-408e-4302-859d-7ea672b93772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":27758},{"type":"v1","addr":"172.21.15.50:6801","nonce":27758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":27758},{"type":"v1","addr":"172.21.15.50:6803","nonce":27758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":27758},{"type":"v1","addr":"172.21.15.50:6810","nonce":27758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6805","nonce":27758},{"type":"v1","addr":"172.21.15.50:6807","nonce":27758}]},"public_addr":"172.21.15.50:6801/27758","cluster_addr":"172.21.15.50:6803/27758","heartbeat_back_addr":"172.21.15.50:6810/27758","heartbeat_front_addr":"172.21.15.50:6807/27758","state":["exists","up"]},{"osd":2,"uuid":"600ea585-aa50-4596-9b14-090eab15f9a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":27759},{"type":"v1","addr":"172.21.15.50:6806","nonce":27759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":27759},{"type":"v1","addr":"172.21.15.50:6811","nonce":27759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":27759},{"type":"v1","addr":"172.21.15.50:6816","nonce":27759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":27759},{"type":"v1","addr":"172.21.15.50:6813","nonce":27759}]},"public_addr":"172.21.15.50:6806/27759","cluster_addr":"172.21.15.50:6811/27759","heartbeat_back_addr":"172.21.15.50:6816/27759","heartbeat_front_addr":"172.21.15.50:6813/27759","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-19T22:07:56.415731+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-19T22:07:56.346062+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-19T22:07:56.090889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-19T22:08:23.756 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.753+0000 7f7780138700 1 -- 172.21.15.50:0/829357234 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f776001fa80 msgr2=0x7f7760021f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:23.756 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.753+0000 7f7780138700 1 --2- 172.21.15.50:0/829357234 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f776001fa80 0x7f7760021f90 crc :-1 s=READY pgs=54 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:23.756 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.753+0000 7f7780138700 1 -- 172.21.15.50:0/829357234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7778090040 msgr2=0x7f7778090470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:23.756 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.753+0000 7f7780138700 1 --2- 172.21.15.50:0/829357234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7778090040 0x7f7778090470 secure :-1 s=READY pgs=221 cs=0 l=1 rx=0x7f77740043a0 tx=0x7f777400c400).stop 2019-12-19T22:08:23.757 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.753+0000 7f7780138700 1 -- 172.21.15.50:0/829357234 shutdown_connections 2019-12-19T22:08:23.757 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.753+0000 7f7780138700 1 --2- 172.21.15.50:0/829357234 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f776001fa80 0x7f7760021f90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:23.757 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.753+0000 7f7780138700 1 --2- 172.21.15.50:0/829357234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7778090040 0x7f7778090470 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:23.757 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.753+0000 7f7780138700 1 -- 172.21.15.50:0/829357234 shutdown_connections 2019-12-19T22:08:23.757 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.753+0000 7f7780138700 1 -- 172.21.15.50:0/829357234 wait complete. 2019-12-19T22:08:23.757 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.753+0000 7f7780138700 1 -- 172.21.15.50:0/829357234 >> 172.21.15.50:0/829357234 conn(0x7f7778091150 msgr2=0x7f777807ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:23.767 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-19T22:08:01.570202+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'13', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-19T22:08:04.515784+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'16', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-19T22:08:05.689151+0000', u'snap_epoch': 19, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': 4, u'last_force_op_resend_preluminous': u'21', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [4], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'21', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'21', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'21', u'min_write_recency_for_promote': 0, u'read_tier': 4}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool,incomplete_clones', u'tier_of': 3, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 4, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-19T22:08:16.355664+0000', u'snap_epoch': 19, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 4, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 3600, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 4, u'pg_num': 4, u'type': 1, u'grade_table': [1000000, 1000000, 1000000, 1000000, 1000000, 1000000, 1000000, 1000000], u'pool_name': u'data_cache', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 4, u'cache_mode': u'writeback', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'21', u'pool': 4, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'target_size': 0, u'seed': 0, u'type': u'bloom', u'false_positive_probability': 0.05}, u'last_force_op_resend': u'21', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'21', u'application_metadata': {}, u'options': {}, u'hit_set_count': 8, u'flags': 9, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'25', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-12-19T22:08:23.768 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-12-19T22:08:23.890 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.882+0000 7fa881913700 1 Processor -- start 2019-12-19T22:08:23.890 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.882+0000 7fa881913700 1 -- start start 2019-12-19T22:08:23.890 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.882+0000 7fa881913700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa87c07dac0 0x7fa87c08eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:23.890 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.882+0000 7fa881913700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa87c08fd30 con 0x7fa87c089510 2019-12-19T22:08:23.890 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.882+0000 7fa881913700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa87c08f8f0 con 0x7fa87c07dac0 2019-12-19T22:08:23.891 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.883+0000 7fa87b7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa87c07dac0 0x7fa87c08eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:23.891 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.883+0000 7fa87b7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa87c07dac0 0x7fa87c08eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53872/0 (socket says 172.21.15.50:53872) 2019-12-19T22:08:23.891 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.883+0000 7fa87b7fe700 1 -- 172.21.15.50:0/793252246 learned_addr learned my addr 172.21.15.50:0/793252246 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:23.891 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.883+0000 7fa87affd700 1 --1- 172.21.15.50:0/793252246 >> v1:172.21.15.50:6789/0 conn(0x7fa87c089510 0x7fa87c07e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40000/0 (socket says 172.21.15.50:40000) 2019-12-19T22:08:23.891 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.883+0000 7fa87b7fe700 1 -- 172.21.15.50:0/793252246 >> v1:172.21.15.50:6789/0 conn(0x7fa87c089510 legacy=0x7fa87c07e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:23.892 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.883+0000 7fa87b7fe700 1 -- 172.21.15.50:0/793252246 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa87c08de50 con 0x7fa87c07dac0 2019-12-19T22:08:23.892 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.883+0000 7fa87b7fe700 1 --2- 172.21.15.50:0/793252246 >> v2:172.21.15.50:3300/0 conn(0x7fa87c07dac0 0x7fa87c08eb70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa86c008790 tx=0x7fa86c00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:23.892 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.883+0000 7fa87b7fe700 1 --2- 172.21.15.50:0/793252246 >> v2:172.21.15.50:3300/0 conn(0x7fa87c07dac0 0x7fa87c08eb70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa86c008790 tx=0x7fa86c00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:23.892 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.883+0000 7fa87b7fe700 1 --2- 172.21.15.50:0/793252246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa87c07dac0 0x7fa87c08eb70 secure :-1 s=READY pgs=223 cs=0 l=1 rx=0x7fa86c008790 tx=0x7fa86c00fcb0).ready entity=mon.0 client_cookie=5e32fa8d50f43ca0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:23.892 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.883+0000 7fa87b7fe700 1 --2- 172.21.15.50:0/793252246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa87c07dac0 0x7fa87c08eb70 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7fa86c008790 tx=0x7fa86c00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:23.892 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.883+0000 7fa87a7fc700 1 -- 172.21.15.50:0/793252246 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fa86c0112f0 con 0x7fa87c07dac0 2019-12-19T22:08:23.892 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.883+0000 7fa87b7fe700 1 --2- 172.21.15.50:0/793252246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa87c07dac0 0x7fa87c08eb70 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7fa86c008790 tx=0x7fa86c00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:23.893 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.883+0000 7fa87b7fe700 1 --2- 172.21.15.50:0/793252246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa87c07dac0 0x7fa87c08eb70 secure :-1 s=THROTTLE_DONE pgs=223 cs=0 l=1 rx=0x7fa86c008790 tx=0x7fa86c00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:23.893 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.883+0000 7fa87a7fc700 1 -- 172.21.15.50:0/793252246 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86c0114f0 con 0x7fa87c07dac0 2019-12-19T22:08:23.893 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.883+0000 7fa87a7fc700 1 -- 172.21.15.50:0/793252246 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fa86c011810 con 0x7fa87c07dac0 2019-12-19T22:08:23.893 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.883+0000 7fa881913700 1 -- 172.21.15.50:0/793252246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa87c07dac0 msgr2=0x7fa87c08eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:23.893 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.883+0000 7fa881913700 1 --2- 172.21.15.50:0/793252246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa87c07dac0 0x7fa87c08eb70 secure :-1 s=READY pgs=223 cs=0 l=1 rx=0x7fa86c008790 tx=0x7fa86c00fcb0).stop 2019-12-19T22:08:23.893 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.884+0000 7fa881913700 1 -- 172.21.15.50:0/793252246 shutdown_connections 2019-12-19T22:08:23.893 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.884+0000 7fa881913700 1 --2- 172.21.15.50:0/793252246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa87c07dac0 0x7fa87c08eb70 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:23.894 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.884+0000 7fa881913700 1 -- 172.21.15.50:0/793252246 shutdown_connections 2019-12-19T22:08:23.894 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.884+0000 7fa881913700 1 -- 172.21.15.50:0/793252246 wait complete. 2019-12-19T22:08:23.895 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.884+0000 7fa881913700 1 -- 172.21.15.50:0/793252246 >> 172.21.15.50:0/793252246 conn(0x7fa87c092f20 msgr2=0x7fa87c08b240 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:23.896 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.885+0000 7fa881913700 1 Processor -- start 2019-12-19T22:08:23.900 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.885+0000 7fa881913700 1 -- start start 2019-12-19T22:08:23.900 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.885+0000 7fa881913700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa87c062610 0x7fa87c05fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:23.901 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.885+0000 7fa881913700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa87c061cb0 con 0x7fa87c060020 2019-12-19T22:08:23.901 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.885+0000 7fa881913700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa87c0614f0 con 0x7fa87c062610 2019-12-19T22:08:23.901 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.885+0000 7fa87b7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa87c062610 0x7fa87c05fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:23.901 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.885+0000 7fa87b7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa87c062610 0x7fa87c05fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53876/0 (socket says 172.21.15.50:53876) 2019-12-19T22:08:23.902 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.885+0000 7fa87b7fe700 1 -- 172.21.15.50:0/2930693569 learned_addr learned my addr 172.21.15.50:0/2930693569 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:23.902 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.886+0000 7fa87b7fe700 1 -- 172.21.15.50:0/2930693569 >> v1:172.21.15.50:6789/0 conn(0x7fa87c060020 legacy=0x7fa87c079fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:23.902 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.886+0000 7fa87b7fe700 1 -- 172.21.15.50:0/2930693569 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa87c07ecd0 con 0x7fa87c062610 2019-12-19T22:08:23.902 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.886+0000 7fa87b7fe700 1 --2- 172.21.15.50:0/2930693569 >> v2:172.21.15.50:3300/0 conn(0x7fa87c062610 0x7fa87c05fad0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa86c008790 tx=0x7fa86c00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:23.902 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.886+0000 7fa87b7fe700 1 --2- 172.21.15.50:0/2930693569 >> v2:172.21.15.50:3300/0 conn(0x7fa87c062610 0x7fa87c05fad0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa86c008790 tx=0x7fa86c00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:23.902 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.886+0000 7fa87b7fe700 1 --2- 172.21.15.50:0/2930693569 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa87c062610 0x7fa87c05fad0 secure :-1 s=READY pgs=225 cs=0 l=1 rx=0x7fa86c008790 tx=0x7fa86c00f780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:23.902 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.886+0000 7fa87b7fe700 1 --2- 172.21.15.50:0/2930693569 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa87c062610 0x7fa87c05fad0 secure :-1 s=THROTTLE_DONE pgs=225 cs=0 l=1 rx=0x7fa86c008790 tx=0x7fa86c00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:23.903 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.886+0000 7fa87b7fe700 1 --2- 172.21.15.50:0/2930693569 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa87c062610 0x7fa87c05fad0 secure :-1 s=THROTTLE_DONE pgs=225 cs=0 l=1 rx=0x7fa86c008790 tx=0x7fa86c00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:23.903 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.886+0000 7fa863fff700 1 -- 172.21.15.50:0/2930693569 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fa86c007280 con 0x7fa87c062610 2019-12-19T22:08:23.903 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.886+0000 7fa87b7fe700 1 --2- 172.21.15.50:0/2930693569 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa87c062610 0x7fa87c05fad0 secure :-1 s=THROTTLE_DONE pgs=225 cs=0 l=1 rx=0x7fa86c008790 tx=0x7fa86c00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:23.903 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.886+0000 7fa863fff700 1 -- 172.21.15.50:0/2930693569 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86c007480 con 0x7fa87c062610 2019-12-19T22:08:23.903 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.886+0000 7fa881913700 1 -- 172.21.15.50:0/2930693569 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa87c061fd0 con 0x7fa87c062610 2019-12-19T22:08:23.903 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.886+0000 7fa863fff700 1 -- 172.21.15.50:0/2930693569 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fa86c011630 con 0x7fa87c062610 2019-12-19T22:08:23.903 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.886+0000 7fa881913700 1 -- 172.21.15.50:0/2930693569 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa87c063470 con 0x7fa87c062610 2019-12-19T22:08:23.904 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.886+0000 7fa87b7fe700 1 --2- 172.21.15.50:0/2930693569 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa87c062610 0x7fa87c05fad0 secure :-1 s=THROTTLE_DONE pgs=225 cs=0 l=1 rx=0x7fa86c008790 tx=0x7fa86c00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:23.904 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.886+0000 7fa863fff700 1 -- 172.21.15.50:0/2930693569 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7fa86c005540 con 0x7fa87c062610 2019-12-19T22:08:23.904 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.886+0000 7fa87b7fe700 1 --2- 172.21.15.50:0/2930693569 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa87c062610 0x7fa87c05fad0 secure :-1 s=THROTTLE_DONE pgs=225 cs=0 l=1 rx=0x7fa86c008790 tx=0x7fa86c00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:23.904 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.887+0000 7fa863fff700 1 --2- 172.21.15.50:0/2930693569 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fa85c01fa50 0x7fa85c021f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:23.904 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.887+0000 7fa863fff700 1 -- 172.21.15.50:0/2930693569 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3786+0+0 (secure 0 0 0) 0x7fa86c02af10 con 0x7fa87c062610 2019-12-19T22:08:23.904 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.887+0000 7fa87affd700 1 --2- 172.21.15.50:0/2930693569 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fa85c01fa50 0x7fa85c021f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:23.904 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.887+0000 7fa87affd700 1 --2- 172.21.15.50:0/2930693569 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fa85c01fa50 0x7fa85c021f60 crc :-1 s=READY pgs=55 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:23.905 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.887+0000 7fa881913700 1 -- 172.21.15.50:0/2930693569 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa87c056340 con 0x7fa87c062610 2019-12-19T22:08:23.905 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.890+0000 7fa87b7fe700 1 --2- 172.21.15.50:0/2930693569 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa87c062610 0x7fa87c05fad0 secure :-1 s=THROTTLE_DONE pgs=225 cs=0 l=1 rx=0x7fa86c008790 tx=0x7fa86c00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:23.905 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:23.891+0000 7fa863fff700 1 -- 172.21.15.50:0/2930693569 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7fa86c005d70 con 0x7fa87c062610 2019-12-19T22:08:24.030 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.027+0000 7fa881913700 1 -- 172.21.15.50:0/2930693569 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa87c095360 con 0x7fa87c062610 2019-12-19T22:08:24.030 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.027+0000 7fa87b7fe700 1 --2- 172.21.15.50:0/2930693569 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa87c062610 0x7fa87c05fad0 secure :-1 s=THROTTLE_DONE pgs=225 cs=0 l=1 rx=0x7fa86c008790 tx=0x7fa86c00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:24.030 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.027+0000 7fa863fff700 1 -- 172.21.15.50:0/2930693569 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa86c005850 con 0x7fa87c062610 2019-12-19T22:08:24.030 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2019-12-19T22:08:24.031 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.028+0000 7fa881913700 1 -- 172.21.15.50:0/2930693569 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fa85c01fa50 msgr2=0x7fa85c021f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:24.031 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.028+0000 7fa881913700 1 --2- 172.21.15.50:0/2930693569 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fa85c01fa50 0x7fa85c021f60 crc :-1 s=READY pgs=55 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:24.031 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.028+0000 7fa881913700 1 -- 172.21.15.50:0/2930693569 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa87c062610 msgr2=0x7fa87c05fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:24.032 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.028+0000 7fa881913700 1 --2- 172.21.15.50:0/2930693569 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa87c062610 0x7fa87c05fad0 secure :-1 s=READY pgs=225 cs=0 l=1 rx=0x7fa86c008790 tx=0x7fa86c00f780).stop 2019-12-19T22:08:24.032 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.028+0000 7fa881913700 1 -- 172.21.15.50:0/2930693569 shutdown_connections 2019-12-19T22:08:24.032 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.028+0000 7fa881913700 1 --2- 172.21.15.50:0/2930693569 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fa85c01fa50 0x7fa85c021f60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:24.032 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.028+0000 7fa881913700 1 --2- 172.21.15.50:0/2930693569 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa87c062610 0x7fa87c05fad0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:24.032 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.028+0000 7fa881913700 1 -- 172.21.15.50:0/2930693569 shutdown_connections 2019-12-19T22:08:24.032 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.028+0000 7fa881913700 1 -- 172.21.15.50:0/2930693569 wait complete. 2019-12-19T22:08:24.033 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.028+0000 7fa881913700 1 -- 172.21.15.50:0/2930693569 >> 172.21.15.50:0/2930693569 conn(0x7fa87c08ffa0 msgr2=0x7fa87c089720 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:24.042 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2019-12-19T22:08:24.167 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.156+0000 7f93f9585700 1 Processor -- start 2019-12-19T22:08:24.167 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.156+0000 7f93f9585700 1 -- start start 2019-12-19T22:08:24.172 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.157+0000 7f93f9585700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f93f4062d90 0x7f93f4080060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:24.172 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.157+0000 7f93f9585700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93f4062a50 con 0x7f93f40636d0 2019-12-19T22:08:24.173 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.157+0000 7f93f9585700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93f4063cb0 con 0x7f93f4062d90 2019-12-19T22:08:24.173 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.157+0000 7f93f3fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f93f4062d90 0x7f93f4080060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:24.173 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.157+0000 7f93f8d84700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f93f40636d0 0x7f93f407f860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40010/0 (socket says 172.21.15.50:40010) 2019-12-19T22:08:24.173 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.157+0000 7f93f3fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f93f4062d90 0x7f93f4080060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53884/0 (socket says 172.21.15.50:53884) 2019-12-19T22:08:24.173 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.157+0000 7f93f8d84700 1 -- 172.21.15.50:0/2853451895 learned_addr learned my addr 172.21.15.50:0/2853451895 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:24.173 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.157+0000 7f93f3fff700 1 -- 172.21.15.50:0/2853451895 >> v1:172.21.15.50:6789/0 conn(0x7f93f40636d0 legacy=0x7f93f407f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:24.174 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.157+0000 7f93f37fe700 1 -- 172.21.15.50:0/2853451895 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1077657241 0 0) 0x7f93f4062a50 con 0x7f93f40636d0 2019-12-19T22:08:24.174 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.157+0000 7f93f3fff700 1 -- 172.21.15.50:0/2853451895 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f40805b0 con 0x7f93f4062d90 2019-12-19T22:08:24.174 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.157+0000 7f93f3fff700 1 --2- 172.21.15.50:0/2853451895 >> v2:172.21.15.50:3300/0 conn(0x7f93f4062d90 0x7f93f4080060 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f93e8008790 tx=0x7f93e800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:24.174 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.157+0000 7f93f3fff700 1 --2- 172.21.15.50:0/2853451895 >> v2:172.21.15.50:3300/0 conn(0x7f93f4062d90 0x7f93f4080060 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f93e8008790 tx=0x7f93e800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:24.174 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.157+0000 7f93f3fff700 1 --2- 172.21.15.50:0/2853451895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93f4062d90 0x7f93f4080060 secure :-1 s=READY pgs=227 cs=0 l=1 rx=0x7f93e8008790 tx=0x7f93e800fbf0).ready entity=mon.0 client_cookie=3d0b764e82f401 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:24.174 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.157+0000 7f93f3fff700 1 --2- 172.21.15.50:0/2853451895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93f4062d90 0x7f93f4080060 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7f93e8008790 tx=0x7f93e800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:24.175 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.157+0000 7f93f37fe700 1 -- 172.21.15.50:0/2853451895 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f93e8011270 con 0x7f93f4062d90 2019-12-19T22:08:24.175 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.157+0000 7f93f3fff700 1 --2- 172.21.15.50:0/2853451895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93f4062d90 0x7f93f4080060 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7f93e8008790 tx=0x7f93e800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:24.175 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.157+0000 7f93f37fe700 1 -- 172.21.15.50:0/2853451895 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e8011470 con 0x7f93f4062d90 2019-12-19T22:08:24.175 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.157+0000 7f93f3fff700 1 --2- 172.21.15.50:0/2853451895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93f4062d90 0x7f93f4080060 secure :-1 s=THROTTLE_DONE pgs=227 cs=0 l=1 rx=0x7f93e8008790 tx=0x7f93e800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:24.175 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.157+0000 7f93f37fe700 1 -- 172.21.15.50:0/2853451895 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f93e8011790 con 0x7f93f4062d90 2019-12-19T22:08:24.175 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.157+0000 7f93f9585700 1 -- 172.21.15.50:0/2853451895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93f4062d90 msgr2=0x7f93f4080060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:24.175 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.157+0000 7f93f9585700 1 --2- 172.21.15.50:0/2853451895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93f4062d90 0x7f93f4080060 secure :-1 s=READY pgs=227 cs=0 l=1 rx=0x7f93e8008790 tx=0x7f93e800fbf0).stop 2019-12-19T22:08:24.176 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.158+0000 7f93f9585700 1 -- 172.21.15.50:0/2853451895 shutdown_connections 2019-12-19T22:08:24.176 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.158+0000 7f93f9585700 1 --2- 172.21.15.50:0/2853451895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93f4062d90 0x7f93f4080060 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:24.176 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.158+0000 7f93f9585700 1 -- 172.21.15.50:0/2853451895 shutdown_connections 2019-12-19T22:08:24.179 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.158+0000 7f93f9585700 1 -- 172.21.15.50:0/2853451895 wait complete. 2019-12-19T22:08:24.179 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.158+0000 7f93f9585700 1 -- 172.21.15.50:0/2853451895 >> 172.21.15.50:0/2853451895 conn(0x7f93f4095760 msgr2=0x7f93f4095b90 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:24.179 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.159+0000 7f93f9585700 1 Processor -- start 2019-12-19T22:08:24.179 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.159+0000 7f93f9585700 1 -- start start 2019-12-19T22:08:24.180 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.159+0000 7f93f9585700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f93f407a400 0x7f93f407a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:24.180 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.159+0000 7f93f9585700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93f407ad80 con 0x7f93f411a8e0 2019-12-19T22:08:24.180 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.159+0000 7f93f9585700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93f40903d0 con 0x7f93f407a400 2019-12-19T22:08:24.180 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.160+0000 7f93f8d84700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f93f407a400 0x7f93f407a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:24.180 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.160+0000 7f93f3fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f93f411a8e0 0x7f93f411ad10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40016/0 (socket says 172.21.15.50:40016) 2019-12-19T22:08:24.180 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.160+0000 7f93f3fff700 1 -- 172.21.15.50:0/2100867100 learned_addr learned my addr 172.21.15.50:0/2100867100 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:24.181 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.160+0000 7f93f8d84700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f93f407a400 0x7f93f407a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53886/0 (socket says 172.21.15.50:53886) 2019-12-19T22:08:24.181 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.160+0000 7f93f8d84700 1 -- 172.21.15.50:0/2100867100 >> v1:172.21.15.50:6789/0 conn(0x7f93f411a8e0 legacy=0x7f93f411ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:24.181 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.160+0000 7f93f17fa700 1 -- 172.21.15.50:0/2100867100 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1754877768 0 0) 0x7f93f407ad80 con 0x7f93f411a8e0 2019-12-19T22:08:24.181 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.160+0000 7f93f8d84700 1 -- 172.21.15.50:0/2100867100 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f4092960 con 0x7f93f407a400 2019-12-19T22:08:24.181 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.160+0000 7f93f8d84700 1 --2- 172.21.15.50:0/2100867100 >> v2:172.21.15.50:3300/0 conn(0x7f93f407a400 0x7f93f407a830 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f93f4090710 tx=0x7f93e4012a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:24.182 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.160+0000 7f93f8d84700 1 --2- 172.21.15.50:0/2100867100 >> v2:172.21.15.50:3300/0 conn(0x7f93f407a400 0x7f93f407a830 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f93f4090710 tx=0x7f93e4012a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:24.182 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.160+0000 7f93f8d84700 1 --2- 172.21.15.50:0/2100867100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93f407a400 0x7f93f407a830 secure :-1 s=READY pgs=229 cs=0 l=1 rx=0x7f93f4090710 tx=0x7f93e4012a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:24.182 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.160+0000 7f93f8d84700 1 --2- 172.21.15.50:0/2100867100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93f407a400 0x7f93f407a830 secure :-1 s=THROTTLE_DONE pgs=229 cs=0 l=1 rx=0x7f93f4090710 tx=0x7f93e4012a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:24.182 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.160+0000 7f93f17fa700 1 -- 172.21.15.50:0/2100867100 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f93e4014730 con 0x7f93f407a400 2019-12-19T22:08:24.182 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.160+0000 7f93f8d84700 1 --2- 172.21.15.50:0/2100867100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93f407a400 0x7f93f407a830 secure :-1 s=THROTTLE_DONE pgs=229 cs=0 l=1 rx=0x7f93f4090710 tx=0x7f93e4012a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:24.182 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.160+0000 7f93f17fa700 1 -- 172.21.15.50:0/2100867100 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e4014930 con 0x7f93f407a400 2019-12-19T22:08:24.182 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.160+0000 7f93f8d84700 1 --2- 172.21.15.50:0/2100867100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93f407a400 0x7f93f407a830 secure :-1 s=THROTTLE_DONE pgs=229 cs=0 l=1 rx=0x7f93f4090710 tx=0x7f93e4012a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:24.183 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.160+0000 7f93f9585700 1 -- 172.21.15.50:0/2100867100 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93f4092620 con 0x7f93f407a400 2019-12-19T22:08:24.183 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.160+0000 7f93f17fa700 1 -- 172.21.15.50:0/2100867100 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f93e4014c50 con 0x7f93f407a400 2019-12-19T22:08:24.183 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.160+0000 7f93f9585700 1 -- 172.21.15.50:0/2100867100 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93f4091000 con 0x7f93f407a400 2019-12-19T22:08:24.183 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.160+0000 7f93f8d84700 1 --2- 172.21.15.50:0/2100867100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93f407a400 0x7f93f407a830 secure :-1 s=THROTTLE_DONE pgs=229 cs=0 l=1 rx=0x7f93f4090710 tx=0x7f93e4012a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:24.184 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.161+0000 7f93f17fa700 1 -- 172.21.15.50:0/2100867100 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7f93e4004430 con 0x7f93f407a400 2019-12-19T22:08:24.184 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.161+0000 7f93f8d84700 1 --2- 172.21.15.50:0/2100867100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93f407a400 0x7f93f407a830 secure :-1 s=THROTTLE_DONE pgs=229 cs=0 l=1 rx=0x7f93f4090710 tx=0x7f93e4012a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:24.184 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.161+0000 7f93f17fa700 1 --2- 172.21.15.50:0/2100867100 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f93d401f9a0 0x7f93d4021eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:24.184 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.161+0000 7f93f17fa700 1 -- 172.21.15.50:0/2100867100 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3786+0+0 (secure 0 0 0) 0x7f93e402c370 con 0x7f93f407a400 2019-12-19T22:08:24.184 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.161+0000 7f93f3fff700 1 --2- 172.21.15.50:0/2100867100 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f93d401f9a0 0x7f93d4021eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:24.184 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.161+0000 7f93f3fff700 1 --2- 172.21.15.50:0/2100867100 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f93d401f9a0 0x7f93d4021eb0 crc :-1 s=READY pgs=56 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:24.185 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.161+0000 7f93f9585700 1 -- 172.21.15.50:0/2100867100 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93f4091c00 con 0x7f93f407a400 2019-12-19T22:08:24.185 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.164+0000 7f93f8d84700 1 --2- 172.21.15.50:0/2100867100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93f407a400 0x7f93f407a830 secure :-1 s=THROTTLE_DONE pgs=229 cs=0 l=1 rx=0x7f93f4090710 tx=0x7f93e4012a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:24.185 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.164+0000 7f93f17fa700 1 -- 172.21.15.50:0/2100867100 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7f93e4009d50 con 0x7f93f407a400 2019-12-19T22:08:24.305 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.303+0000 7f93f9585700 1 -- 172.21.15.50:0/2100867100 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f93f4056340 con 0x7f93f407a400 2019-12-19T22:08:24.305 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.303+0000 7f93f8d84700 1 --2- 172.21.15.50:0/2100867100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93f407a400 0x7f93f407a830 secure :-1 s=THROTTLE_DONE pgs=229 cs=0 l=1 rx=0x7f93f4090710 tx=0x7f93e4012a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:24.306 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.303+0000 7f93f17fa700 1 -- 172.21.15.50:0/2100867100 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7f93e4004c60 con 0x7f93f407a400 2019-12-19T22:08:24.306 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2019-12-19T22:08:24.308 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.304+0000 7f93f9585700 1 -- 172.21.15.50:0/2100867100 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f93d401f9a0 msgr2=0x7f93d4021eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:24.308 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.304+0000 7f93f9585700 1 --2- 172.21.15.50:0/2100867100 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f93d401f9a0 0x7f93d4021eb0 crc :-1 s=READY pgs=56 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:24.309 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.304+0000 7f93f9585700 1 -- 172.21.15.50:0/2100867100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93f407a400 msgr2=0x7f93f407a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:24.309 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.304+0000 7f93f9585700 1 --2- 172.21.15.50:0/2100867100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93f407a400 0x7f93f407a830 secure :-1 s=READY pgs=229 cs=0 l=1 rx=0x7f93f4090710 tx=0x7f93e4012a60).stop 2019-12-19T22:08:24.309 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.304+0000 7f93f9585700 1 -- 172.21.15.50:0/2100867100 shutdown_connections 2019-12-19T22:08:24.309 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.304+0000 7f93f9585700 1 --2- 172.21.15.50:0/2100867100 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f93d401f9a0 0x7f93d4021eb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:24.309 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.304+0000 7f93f9585700 1 --2- 172.21.15.50:0/2100867100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f93f407a400 0x7f93f407a830 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:24.309 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.304+0000 7f93f9585700 1 -- 172.21.15.50:0/2100867100 shutdown_connections 2019-12-19T22:08:24.310 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.304+0000 7f93f9585700 1 -- 172.21.15.50:0/2100867100 wait complete. 2019-12-19T22:08:24.310 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.304+0000 7f93f9585700 1 -- 172.21.15.50:0/2100867100 >> 172.21.15.50:0/2100867100 conn(0x7f93f40636d0 msgr2=0x7f93f4061050 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:24.317 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2019-12-19T22:08:24.453 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.431+0000 7f29e987f700 1 Processor -- start 2019-12-19T22:08:24.453 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.431+0000 7f29e987f700 1 -- start start 2019-12-19T22:08:24.453 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.432+0000 7f29e987f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f29e407dac0 0x7f29e408eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:24.454 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.432+0000 7f29e987f700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29e408fd30 con 0x7f29e4089510 2019-12-19T22:08:24.454 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.432+0000 7f29e987f700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29e408f8f0 con 0x7f29e407dac0 2019-12-19T22:08:24.454 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.432+0000 7f29e37fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f29e407dac0 0x7f29e408eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:24.454 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.432+0000 7f29e37fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f29e407dac0 0x7f29e408eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53892/0 (socket says 172.21.15.50:53892) 2019-12-19T22:08:24.454 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.432+0000 7f29e37fe700 1 -- 172.21.15.50:0/3434075552 learned_addr learned my addr 172.21.15.50:0/3434075552 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:24.454 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.432+0000 7f29e37fe700 1 -- 172.21.15.50:0/3434075552 >> v1:172.21.15.50:6789/0 conn(0x7f29e4089510 legacy=0x7f29e407e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:24.454 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.432+0000 7f29e37fe700 1 -- 172.21.15.50:0/3434075552 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e408de50 con 0x7f29e407dac0 2019-12-19T22:08:24.455 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.432+0000 7f29e37fe700 1 --2- 172.21.15.50:0/3434075552 >> v2:172.21.15.50:3300/0 conn(0x7f29e407dac0 0x7f29e408eb70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f29d4008790 tx=0x7f29d400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:24.455 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.432+0000 7f29e37fe700 1 --2- 172.21.15.50:0/3434075552 >> v2:172.21.15.50:3300/0 conn(0x7f29e407dac0 0x7f29e408eb70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f29d4008790 tx=0x7f29d400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:24.455 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.432+0000 7f29e37fe700 1 --2- 172.21.15.50:0/3434075552 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29e407dac0 0x7f29e408eb70 secure :-1 s=READY pgs=231 cs=0 l=1 rx=0x7f29d4008790 tx=0x7f29d400fcb0).ready entity=mon.0 client_cookie=a38188cc8c74e585 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:24.455 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.432+0000 7f29e37fe700 1 --2- 172.21.15.50:0/3434075552 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29e407dac0 0x7f29e408eb70 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7f29d4008790 tx=0x7f29d400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:24.455 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.432+0000 7f29e27fc700 1 -- 172.21.15.50:0/3434075552 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f29d40112f0 con 0x7f29e407dac0 2019-12-19T22:08:24.455 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.432+0000 7f29e37fe700 1 --2- 172.21.15.50:0/3434075552 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29e407dac0 0x7f29e408eb70 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7f29d4008790 tx=0x7f29d400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:24.455 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.432+0000 7f29e37fe700 1 --2- 172.21.15.50:0/3434075552 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29e407dac0 0x7f29e408eb70 secure :-1 s=THROTTLE_DONE pgs=231 cs=0 l=1 rx=0x7f29d4008790 tx=0x7f29d400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:24.456 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.432+0000 7f29e27fc700 1 -- 172.21.15.50:0/3434075552 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d40114f0 con 0x7f29e407dac0 2019-12-19T22:08:24.456 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.432+0000 7f29e27fc700 1 -- 172.21.15.50:0/3434075552 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f29d4011810 con 0x7f29e407dac0 2019-12-19T22:08:24.456 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.432+0000 7f29e987f700 1 -- 172.21.15.50:0/3434075552 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29e407dac0 msgr2=0x7f29e408eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:24.456 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.432+0000 7f29e987f700 1 --2- 172.21.15.50:0/3434075552 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29e407dac0 0x7f29e408eb70 secure :-1 s=READY pgs=231 cs=0 l=1 rx=0x7f29d4008790 tx=0x7f29d400fcb0).stop 2019-12-19T22:08:24.472 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.433+0000 7f29e987f700 1 -- 172.21.15.50:0/3434075552 shutdown_connections 2019-12-19T22:08:24.473 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.433+0000 7f29e987f700 1 --2- 172.21.15.50:0/3434075552 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29e407dac0 0x7f29e408eb70 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:24.473 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.433+0000 7f29e987f700 1 -- 172.21.15.50:0/3434075552 shutdown_connections 2019-12-19T22:08:24.473 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.433+0000 7f29e987f700 1 -- 172.21.15.50:0/3434075552 wait complete. 2019-12-19T22:08:24.473 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.433+0000 7f29e987f700 1 -- 172.21.15.50:0/3434075552 >> 172.21.15.50:0/3434075552 conn(0x7f29e4092f20 msgr2=0x7f29e408b240 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:24.473 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.434+0000 7f29e987f700 1 Processor -- start 2019-12-19T22:08:24.473 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.434+0000 7f29e987f700 1 -- start start 2019-12-19T22:08:24.474 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.434+0000 7f29e987f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f29e407a4d0 0x7f29e407a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:24.474 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.434+0000 7f29e987f700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29e4064b10 con 0x7f29e4061c30 2019-12-19T22:08:24.474 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.434+0000 7f29e987f700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29e40917a0 con 0x7f29e407a4d0 2019-12-19T22:08:24.474 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.434+0000 7f29e37fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f29e407a4d0 0x7f29e407a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:24.474 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.434+0000 7f29e2ffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f29e4061c30 0x7f29e4062060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40022/0 (socket says 172.21.15.50:40022) 2019-12-19T22:08:24.474 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.434+0000 7f29e37fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f29e407a4d0 0x7f29e407a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53894/0 (socket says 172.21.15.50:53894) 2019-12-19T22:08:24.474 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.434+0000 7f29e2ffd700 1 -- 172.21.15.50:0/1763860233 learned_addr learned my addr 172.21.15.50:0/1763860233 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:24.475 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.435+0000 7f29e37fe700 1 -- 172.21.15.50:0/1763860233 >> v1:172.21.15.50:6789/0 conn(0x7f29e4061c30 legacy=0x7f29e4062060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:24.475 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.435+0000 7f29dbfff700 1 -- 172.21.15.50:0/1763860233 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2432889273 0 0) 0x7f29e4064b10 con 0x7f29e4061c30 2019-12-19T22:08:24.475 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.435+0000 7f29e37fe700 1 -- 172.21.15.50:0/1763860233 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e4066240 con 0x7f29e407a4d0 2019-12-19T22:08:24.475 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.435+0000 7f29e37fe700 1 --2- 172.21.15.50:0/1763860233 >> v2:172.21.15.50:3300/0 conn(0x7f29e407a4d0 0x7f29e407a900 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f29d4008790 tx=0x7f29d400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:24.475 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.435+0000 7f29e37fe700 1 --2- 172.21.15.50:0/1763860233 >> v2:172.21.15.50:3300/0 conn(0x7f29e407a4d0 0x7f29e407a900 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f29d4008790 tx=0x7f29d400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:24.475 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.435+0000 7f29e37fe700 1 --2- 172.21.15.50:0/1763860233 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29e407a4d0 0x7f29e407a900 secure :-1 s=READY pgs=233 cs=0 l=1 rx=0x7f29d4008790 tx=0x7f29d400f780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:24.475 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.435+0000 7f29e37fe700 1 --2- 172.21.15.50:0/1763860233 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29e407a4d0 0x7f29e407a900 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f29d4008790 tx=0x7f29d400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:24.476 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.435+0000 7f29dbfff700 1 -- 172.21.15.50:0/1763860233 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f29d4007280 con 0x7f29e407a4d0 2019-12-19T22:08:24.476 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.435+0000 7f29e37fe700 1 --2- 172.21.15.50:0/1763860233 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29e407a4d0 0x7f29e407a900 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f29d4008790 tx=0x7f29d400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:24.476 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.435+0000 7f29e37fe700 1 --2- 172.21.15.50:0/1763860233 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29e407a4d0 0x7f29e407a900 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f29d4008790 tx=0x7f29d400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:24.476 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.435+0000 7f29dbfff700 1 -- 172.21.15.50:0/1763860233 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d4011500 con 0x7f29e407a4d0 2019-12-19T22:08:24.476 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.435+0000 7f29e987f700 1 -- 172.21.15.50:0/1763860233 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29e407ae50 con 0x7f29e407a4d0 2019-12-19T22:08:24.476 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.435+0000 7f29dbfff700 1 -- 172.21.15.50:0/1763860233 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f29d4005540 con 0x7f29e407a4d0 2019-12-19T22:08:24.476 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.435+0000 7f29e987f700 1 -- 172.21.15.50:0/1763860233 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29e4063f10 con 0x7f29e407a4d0 2019-12-19T22:08:24.477 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.435+0000 7f29e37fe700 1 --2- 172.21.15.50:0/1763860233 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29e407a4d0 0x7f29e407a900 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f29d4008790 tx=0x7f29d400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:24.477 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.436+0000 7f29dbfff700 1 -- 172.21.15.50:0/1763860233 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7f29d4005860 con 0x7f29e407a4d0 2019-12-19T22:08:24.477 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.436+0000 7f29e37fe700 1 --2- 172.21.15.50:0/1763860233 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29e407a4d0 0x7f29e407a900 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f29d4008790 tx=0x7f29d400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:24.477 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.436+0000 7f29dbfff700 1 --2- 172.21.15.50:0/1763860233 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f29c001f9a0 0x7f29c0021eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:24.477 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.436+0000 7f29dbfff700 1 -- 172.21.15.50:0/1763860233 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3786+0+0 (secure 0 0 0) 0x7f29d402adf0 con 0x7f29e407a4d0 2019-12-19T22:08:24.477 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.436+0000 7f29e2ffd700 1 --2- 172.21.15.50:0/1763860233 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f29c001f9a0 0x7f29c0021eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:24.477 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.436+0000 7f29e2ffd700 1 --2- 172.21.15.50:0/1763860233 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f29c001f9a0 0x7f29c0021eb0 crc :-1 s=READY pgs=57 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:24.477 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.436+0000 7f29e987f700 1 -- 172.21.15.50:0/1763860233 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29e4056340 con 0x7f29e407a4d0 2019-12-19T22:08:24.478 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.439+0000 7f29e37fe700 1 --2- 172.21.15.50:0/1763860233 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29e407a4d0 0x7f29e407a900 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f29d4008790 tx=0x7f29d400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:24.478 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.439+0000 7f29dbfff700 1 -- 172.21.15.50:0/1763860233 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7f29d400d400 con 0x7f29e407a4d0 2019-12-19T22:08:24.582 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.579+0000 7f29e987f700 1 -- 172.21.15.50:0/1763860233 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f29e4063120 con 0x7f29e407a4d0 2019-12-19T22:08:24.582 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.580+0000 7f29e37fe700 1 --2- 172.21.15.50:0/1763860233 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29e407a4d0 0x7f29e407a900 secure :-1 s=THROTTLE_DONE pgs=233 cs=0 l=1 rx=0x7f29d4008790 tx=0x7f29d400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:24.582 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.580+0000 7f29dbfff700 1 -- 172.21.15.50:0/1763860233 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7f29d402a8d0 con 0x7f29e407a4d0 2019-12-19T22:08:24.582 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 8 2019-12-19T22:08:24.583 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.581+0000 7f29e987f700 1 -- 172.21.15.50:0/1763860233 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f29c001f9a0 msgr2=0x7f29c0021eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:24.584 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.581+0000 7f29e987f700 1 --2- 172.21.15.50:0/1763860233 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f29c001f9a0 0x7f29c0021eb0 crc :-1 s=READY pgs=57 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:24.584 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.581+0000 7f29e987f700 1 -- 172.21.15.50:0/1763860233 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29e407a4d0 msgr2=0x7f29e407a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:24.584 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.581+0000 7f29e987f700 1 --2- 172.21.15.50:0/1763860233 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29e407a4d0 0x7f29e407a900 secure :-1 s=READY pgs=233 cs=0 l=1 rx=0x7f29d4008790 tx=0x7f29d400f780).stop 2019-12-19T22:08:24.584 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.581+0000 7f29e987f700 1 -- 172.21.15.50:0/1763860233 shutdown_connections 2019-12-19T22:08:24.584 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.581+0000 7f29e987f700 1 --2- 172.21.15.50:0/1763860233 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f29c001f9a0 0x7f29c0021eb0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:24.584 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.581+0000 7f29e987f700 1 --2- 172.21.15.50:0/1763860233 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29e407a4d0 0x7f29e407a900 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:24.585 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.581+0000 7f29e987f700 1 -- 172.21.15.50:0/1763860233 shutdown_connections 2019-12-19T22:08:24.585 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.581+0000 7f29e987f700 1 -- 172.21.15.50:0/1763860233 wait complete. 2019-12-19T22:08:24.585 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.581+0000 7f29e987f700 1 -- 172.21.15.50:0/1763860233 >> 172.21.15.50:0/1763860233 conn(0x7f29e408ffa0 msgr2=0x7f29e4089720 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:24.609 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_cache pg_num 2019-12-19T22:08:24.728 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.724+0000 7f4519682700 1 Processor -- start 2019-12-19T22:08:24.729 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.724+0000 7f4519682700 1 -- start start 2019-12-19T22:08:24.729 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.724+0000 7f4519682700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f451408eb70 0x7f451407e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:24.729 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.724+0000 7f4519682700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f451408fd30 con 0x7f451407dac0 2019-12-19T22:08:24.729 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.724+0000 7f4519682700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4514089d10 con 0x7f451408eb70 2019-12-19T22:08:24.729 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.724+0000 7f4512ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f451408eb70 0x7f451407e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:24.729 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.724+0000 7f4512ffd700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f451408eb70 0x7f451407e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53900/0 (socket says 172.21.15.50:53900) 2019-12-19T22:08:24.730 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.724+0000 7f4512ffd700 1 -- 172.21.15.50:0/4053111048 learned_addr learned my addr 172.21.15.50:0/4053111048 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:24.730 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.724+0000 7f45137fe700 1 --1- 172.21.15.50:0/4053111048 >> v1:172.21.15.50:6789/0 conn(0x7f451407dac0 0x7f4514089510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40028/0 (socket says 172.21.15.50:40028) 2019-12-19T22:08:24.730 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.725+0000 7f4512ffd700 1 -- 172.21.15.50:0/4053111048 >> v1:172.21.15.50:6789/0 conn(0x7f451407dac0 legacy=0x7f4514089510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:24.730 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.725+0000 7f4512ffd700 1 -- 172.21.15.50:0/4053111048 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f451408f8f0 con 0x7f451408eb70 2019-12-19T22:08:24.730 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.725+0000 7f4512ffd700 1 --2- 172.21.15.50:0/4053111048 >> v2:172.21.15.50:3300/0 conn(0x7f451408eb70 0x7f451407e000 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4504008790 tx=0x7f450400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:24.730 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.725+0000 7f4512ffd700 1 --2- 172.21.15.50:0/4053111048 >> v2:172.21.15.50:3300/0 conn(0x7f451408eb70 0x7f451407e000 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4504008790 tx=0x7f450400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:24.731 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.725+0000 7f4512ffd700 1 --2- 172.21.15.50:0/4053111048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f451408eb70 0x7f451407e000 secure :-1 s=READY pgs=235 cs=0 l=1 rx=0x7f4504008790 tx=0x7f450400fcb0).ready entity=mon.0 client_cookie=eedb158b275e2252 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:24.731 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.725+0000 7f4512ffd700 1 --2- 172.21.15.50:0/4053111048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f451408eb70 0x7f451407e000 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7f4504008790 tx=0x7f450400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:24.731 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.725+0000 7f45127fc700 1 -- 172.21.15.50:0/4053111048 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f4504011330 con 0x7f451408eb70 2019-12-19T22:08:24.731 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.725+0000 7f4512ffd700 1 --2- 172.21.15.50:0/4053111048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f451408eb70 0x7f451407e000 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7f4504008790 tx=0x7f450400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:24.731 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.725+0000 7f45127fc700 1 -- 172.21.15.50:0/4053111048 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4504011530 con 0x7f451408eb70 2019-12-19T22:08:24.731 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.725+0000 7f4512ffd700 1 --2- 172.21.15.50:0/4053111048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f451408eb70 0x7f451407e000 secure :-1 s=THROTTLE_DONE pgs=235 cs=0 l=1 rx=0x7f4504008790 tx=0x7f450400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:24.731 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.725+0000 7f4519682700 1 -- 172.21.15.50:0/4053111048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f451408eb70 msgr2=0x7f451407e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:24.732 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.725+0000 7f45127fc700 1 -- 172.21.15.50:0/4053111048 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f4504011850 con 0x7f451408eb70 2019-12-19T22:08:24.732 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.725+0000 7f4519682700 1 --2- 172.21.15.50:0/4053111048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f451408eb70 0x7f451407e000 secure :-1 s=READY pgs=235 cs=0 l=1 rx=0x7f4504008790 tx=0x7f450400fcb0).stop 2019-12-19T22:08:24.732 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.725+0000 7f4519682700 1 -- 172.21.15.50:0/4053111048 shutdown_connections 2019-12-19T22:08:24.732 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.725+0000 7f4519682700 1 --2- 172.21.15.50:0/4053111048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f451408eb70 0x7f451407e000 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:24.745 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.725+0000 7f4519682700 1 -- 172.21.15.50:0/4053111048 shutdown_connections 2019-12-19T22:08:24.745 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.725+0000 7f4519682700 1 -- 172.21.15.50:0/4053111048 wait complete. 2019-12-19T22:08:24.745 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.725+0000 7f4519682700 1 -- 172.21.15.50:0/4053111048 >> 172.21.15.50:0/4053111048 conn(0x7f4514092f20 msgr2=0x7f451408b240 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:24.745 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.726+0000 7f4519682700 1 Processor -- start 2019-12-19T22:08:24.745 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.726+0000 7f4519682700 1 -- start start 2019-12-19T22:08:24.755 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.727+0000 7f4519682700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4514062000 0x7f4514062430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:24.755 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.727+0000 7f4519682700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4514062db0 con 0x7f4514062980 2019-12-19T22:08:24.755 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.727+0000 7f4519682700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4514063c60 con 0x7f4514062000 2019-12-19T22:08:24.755 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.727+0000 7f45137fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4514062000 0x7f4514062430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:24.756 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.727+0000 7f45137fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f4514062000 0x7f4514062430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53904/0 (socket says 172.21.15.50:53904) 2019-12-19T22:08:24.756 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.727+0000 7f4512ffd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f4514062980 0x7f4514079fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40034/0 (socket says 172.21.15.50:40034) 2019-12-19T22:08:24.756 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.727+0000 7f45137fe700 1 -- 172.21.15.50:0/631075646 learned_addr learned my addr 172.21.15.50:0/631075646 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:24.756 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.727+0000 7f45137fe700 1 -- 172.21.15.50:0/631075646 >> v1:172.21.15.50:6789/0 conn(0x7f4514062980 legacy=0x7f4514079fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:24.758 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.727+0000 7f45137fe700 1 -- 172.21.15.50:0/631075646 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4514065020 con 0x7f4514062000 2019-12-19T22:08:24.758 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.727+0000 7f45137fe700 1 --2- 172.21.15.50:0/631075646 >> v2:172.21.15.50:3300/0 conn(0x7f4514062000 0x7f4514062430 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4508001450 tx=0x7f4508010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:24.759 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.727+0000 7f45137fe700 1 --2- 172.21.15.50:0/631075646 >> v2:172.21.15.50:3300/0 conn(0x7f4514062000 0x7f4514062430 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4508001450 tx=0x7f4508010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:24.759 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.727+0000 7f45137fe700 1 --2- 172.21.15.50:0/631075646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4514062000 0x7f4514062430 secure :-1 s=READY pgs=237 cs=0 l=1 rx=0x7f4508001450 tx=0x7f4508010940).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:24.759 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.727+0000 7f45137fe700 1 --2- 172.21.15.50:0/631075646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4514062000 0x7f4514062430 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7f4508001450 tx=0x7f4508010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:24.759 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.727+0000 7f45137fe700 1 --2- 172.21.15.50:0/631075646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4514062000 0x7f4514062430 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7f4508001450 tx=0x7f4508010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:24.759 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.727+0000 7f44fbfff700 1 -- 172.21.15.50:0/631075646 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f4508011430 con 0x7f4514062000 2019-12-19T22:08:24.760 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.728+0000 7f45137fe700 1 --2- 172.21.15.50:0/631075646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4514062000 0x7f4514062430 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7f4508001450 tx=0x7f4508010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:24.760 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.728+0000 7f44fbfff700 1 -- 172.21.15.50:0/631075646 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4508011630 con 0x7f4514062000 2019-12-19T22:08:24.760 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.728+0000 7f4519682700 1 -- 172.21.15.50:0/631075646 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45140644e0 con 0x7f4514062000 2019-12-19T22:08:24.760 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.728+0000 7f44fbfff700 1 -- 172.21.15.50:0/631075646 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f4508011a10 con 0x7f4514062000 2019-12-19T22:08:24.760 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.728+0000 7f4519682700 1 -- 172.21.15.50:0/631075646 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4514064220 con 0x7f4514062000 2019-12-19T22:08:24.760 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.728+0000 7f45137fe700 1 --2- 172.21.15.50:0/631075646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4514062000 0x7f4514062430 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7f4508001450 tx=0x7f4508010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:24.761 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.728+0000 7f44fbfff700 1 -- 172.21.15.50:0/631075646 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7f4508006460 con 0x7f4514062000 2019-12-19T22:08:24.761 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.728+0000 7f45137fe700 1 --2- 172.21.15.50:0/631075646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4514062000 0x7f4514062430 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7f4508001450 tx=0x7f4508010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:24.761 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.728+0000 7f44fbfff700 1 --2- 172.21.15.50:0/631075646 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f44f401fa80 0x7f44f4021f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:24.761 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.728+0000 7f44fbfff700 1 -- 172.21.15.50:0/631075646 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3786+0+0 (secure 0 0 0) 0x7f450802a130 con 0x7f4514062000 2019-12-19T22:08:24.762 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.728+0000 7f4512ffd700 1 --2- 172.21.15.50:0/631075646 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f44f401fa80 0x7f44f4021f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:24.762 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.729+0000 7f4512ffd700 1 --2- 172.21.15.50:0/631075646 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f44f401fa80 0x7f44f4021f90 crc :-1 s=READY pgs=58 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:24.762 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.729+0000 7f4519682700 1 -- 172.21.15.50:0/631075646 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4514056340 con 0x7f4514062000 2019-12-19T22:08:24.762 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.732+0000 7f45137fe700 1 --2- 172.21.15.50:0/631075646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4514062000 0x7f4514062430 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7f4508001450 tx=0x7f4508010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:24.762 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.732+0000 7f44fbfff700 1 -- 172.21.15.50:0/631075646 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7f450800c3c0 con 0x7f4514062000 2019-12-19T22:08:24.876 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.870+0000 7f4519682700 1 -- 172.21.15.50:0/631075646 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_cache", "var": "pg_num"} v 0) v1 -- 0x7f45140906b0 con 0x7f4514062000 2019-12-19T22:08:24.876 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.870+0000 7f45137fe700 1 --2- 172.21.15.50:0/631075646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4514062000 0x7f4514062430 secure :-1 s=THROTTLE_DONE pgs=237 cs=0 l=1 rx=0x7f4508001450 tx=0x7f4508010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:24.876 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.870+0000 7f44fbfff700 1 -- 172.21.15.50:0/631075646 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_cache", "var": "pg_num"}]=0 v25) v1 ==== 99+0+10 (secure 0 0 0) 0x7f45080101b0 con 0x7f4514062000 2019-12-19T22:08:24.877 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.871+0000 7f4519682700 1 -- 172.21.15.50:0/631075646 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f44f401fa80 msgr2=0x7f44f4021f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:24.877 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.871+0000 7f4519682700 1 --2- 172.21.15.50:0/631075646 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f44f401fa80 0x7f44f4021f90 crc :-1 s=READY pgs=58 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:24.877 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.871+0000 7f4519682700 1 -- 172.21.15.50:0/631075646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4514062000 msgr2=0x7f4514062430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:24.877 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.871+0000 7f4519682700 1 --2- 172.21.15.50:0/631075646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4514062000 0x7f4514062430 secure :-1 s=READY pgs=237 cs=0 l=1 rx=0x7f4508001450 tx=0x7f4508010940).stop 2019-12-19T22:08:24.877 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.871+0000 7f4519682700 1 -- 172.21.15.50:0/631075646 shutdown_connections 2019-12-19T22:08:24.878 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.871+0000 7f4519682700 1 --2- 172.21.15.50:0/631075646 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f44f401fa80 0x7f44f4021f90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:24.878 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.871+0000 7f4519682700 1 --2- 172.21.15.50:0/631075646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4514062000 0x7f4514062430 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:24.878 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.871+0000 7f4519682700 1 -- 172.21.15.50:0/631075646 shutdown_connections 2019-12-19T22:08:24.878 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.871+0000 7f4519682700 1 -- 172.21.15.50:0/631075646 wait complete. 2019-12-19T22:08:24.878 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.871+0000 7f4519682700 1 -- 172.21.15.50:0/631075646 >> 172.21.15.50:0/631075646 conn(0x7f45140919e0 msgr2=0x7f451407d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:24.878 INFO:teuthology.orchestra.run.smithi050.stdout:pg_num: 4 2019-12-19T22:08:24.887 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2019-12-19T22:08:24.887 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2019-12-19T22:08:25.007 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.998+0000 7effb8819700 1 Processor -- start 2019-12-19T22:08:25.007 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.998+0000 7effb8819700 1 -- start start 2019-12-19T22:08:25.007 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.999+0000 7effb8819700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7effb40898b0 0x7effb4081170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:25.007 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.999+0000 7effb8819700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effb4089ce0 con 0x7effb4089480 2019-12-19T22:08:25.008 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.999+0000 7effb8819700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effb408ae60 con 0x7effb40898b0 2019-12-19T22:08:25.008 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.999+0000 7effb259c700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7effb40898b0 0x7effb4081170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:25.008 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.999+0000 7effb2d9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7effb4089480 0x7effb408f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40038/0 (socket says 172.21.15.50:40038) 2019-12-19T22:08:25.008 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.999+0000 7effb2d9d700 1 -- 172.21.15.50:0/2988290385 learned_addr learned my addr 172.21.15.50:0/2988290385 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:25.008 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.999+0000 7effb259c700 1 -- 172.21.15.50:0/2988290385 >> v1:172.21.15.50:6789/0 conn(0x7effb4089480 legacy=0x7effb408f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:25.008 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.999+0000 7effb1d9b700 1 -- 172.21.15.50:0/2988290385 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 435097932 0 0) 0x7effb4089ce0 con 0x7effb4089480 2019-12-19T22:08:25.008 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.999+0000 7effb259c700 1 -- 172.21.15.50:0/2988290385 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb408edb0 con 0x7effb40898b0 2019-12-19T22:08:25.009 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.999+0000 7effb259c700 1 --2- 172.21.15.50:0/2988290385 >> v2:172.21.15.50:3300/0 conn(0x7effb40898b0 0x7effb4081170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7effa8008790 tx=0x7effa800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:25.009 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.999+0000 7effb259c700 1 --2- 172.21.15.50:0/2988290385 >> v2:172.21.15.50:3300/0 conn(0x7effb40898b0 0x7effb4081170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7effa8008790 tx=0x7effa800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:25.009 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.999+0000 7effb259c700 1 --2- 172.21.15.50:0/2988290385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effb40898b0 0x7effb4081170 secure :-1 s=READY pgs=239 cs=0 l=1 rx=0x7effa8008790 tx=0x7effa800fbf0).ready entity=mon.0 client_cookie=834d9cf1abc14489 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:25.009 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.999+0000 7effb259c700 1 --2- 172.21.15.50:0/2988290385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effb40898b0 0x7effb4081170 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7effa8008790 tx=0x7effa800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:25.009 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.999+0000 7effb1d9b700 1 -- 172.21.15.50:0/2988290385 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7effa8011270 con 0x7effb40898b0 2019-12-19T22:08:25.009 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.999+0000 7effb259c700 1 --2- 172.21.15.50:0/2988290385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effb40898b0 0x7effb4081170 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7effa8008790 tx=0x7effa800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:25.009 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.999+0000 7effb259c700 1 --2- 172.21.15.50:0/2988290385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effb40898b0 0x7effb4081170 secure :-1 s=THROTTLE_DONE pgs=239 cs=0 l=1 rx=0x7effa8008790 tx=0x7effa800fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:25.010 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.999+0000 7effb1d9b700 1 -- 172.21.15.50:0/2988290385 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa8011470 con 0x7effb40898b0 2019-12-19T22:08:25.010 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.999+0000 7effb1d9b700 1 -- 172.21.15.50:0/2988290385 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7effa8011790 con 0x7effb40898b0 2019-12-19T22:08:25.010 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.999+0000 7effb8819700 1 -- 172.21.15.50:0/2988290385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effb40898b0 msgr2=0x7effb4081170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:25.010 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:24.999+0000 7effb8819700 1 --2- 172.21.15.50:0/2988290385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effb40898b0 0x7effb4081170 secure :-1 s=READY pgs=239 cs=0 l=1 rx=0x7effa8008790 tx=0x7effa800fbf0).stop 2019-12-19T22:08:25.010 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.000+0000 7effb8819700 1 -- 172.21.15.50:0/2988290385 shutdown_connections 2019-12-19T22:08:25.010 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.000+0000 7effb8819700 1 --2- 172.21.15.50:0/2988290385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effb40898b0 0x7effb4081170 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:25.010 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.000+0000 7effb8819700 1 -- 172.21.15.50:0/2988290385 shutdown_connections 2019-12-19T22:08:25.011 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.000+0000 7effb8819700 1 -- 172.21.15.50:0/2988290385 wait complete. 2019-12-19T22:08:25.011 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.000+0000 7effb8819700 1 -- 172.21.15.50:0/2988290385 >> 172.21.15.50:0/2988290385 conn(0x7effb4067e70 msgr2=0x7effb4094570 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:25.011 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.001+0000 7effb8819700 1 Processor -- start 2019-12-19T22:08:25.011 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.001+0000 7effb8819700 1 -- start start 2019-12-19T22:08:25.011 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.001+0000 7effb8819700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7effb41216f0 0x7effb4121b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:25.011 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.001+0000 7effb8819700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effb4088030 con 0x7effb4122070 2019-12-19T22:08:25.011 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.001+0000 7effb8819700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effb407e2b0 con 0x7effb41216f0 2019-12-19T22:08:25.012 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.001+0000 7effb2d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7effb41216f0 0x7effb4121b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:25.012 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.001+0000 7effb2d9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7effb41216f0 0x7effb4121b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53914/0 (socket says 172.21.15.50:53914) 2019-12-19T22:08:25.012 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.001+0000 7effb2d9d700 1 -- 172.21.15.50:0/3418300868 learned_addr learned my addr 172.21.15.50:0/3418300868 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:25.012 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.002+0000 7effb2d9d700 1 -- 172.21.15.50:0/3418300868 >> v1:172.21.15.50:6789/0 conn(0x7effb4122070 legacy=0x7effb4086820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:25.012 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.002+0000 7effb2d9d700 1 -- 172.21.15.50:0/3418300868 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb41224a0 con 0x7effb41216f0 2019-12-19T22:08:25.012 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.002+0000 7effb2d9d700 1 --2- 172.21.15.50:0/3418300868 >> v2:172.21.15.50:3300/0 conn(0x7effb41216f0 0x7effb4121b20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7effa40043a0 tx=0x7effa40108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:25.012 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.002+0000 7effb2d9d700 1 --2- 172.21.15.50:0/3418300868 >> v2:172.21.15.50:3300/0 conn(0x7effb41216f0 0x7effb4121b20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7effa40043a0 tx=0x7effa40108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:25.013 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.002+0000 7effb2d9d700 1 --2- 172.21.15.50:0/3418300868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effb41216f0 0x7effb4121b20 secure :-1 s=READY pgs=241 cs=0 l=1 rx=0x7effa40043a0 tx=0x7effa40108f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:25.013 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.002+0000 7effb2d9d700 1 --2- 172.21.15.50:0/3418300868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effb41216f0 0x7effb4121b20 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7effa40043a0 tx=0x7effa40108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:25.013 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.002+0000 7effb2d9d700 1 --2- 172.21.15.50:0/3418300868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effb41216f0 0x7effb4121b20 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7effa40043a0 tx=0x7effa40108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:25.013 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.002+0000 7effa37fe700 1 -- 172.21.15.50:0/3418300868 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7effa4011590 con 0x7effb41216f0 2019-12-19T22:08:25.013 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.002+0000 7effb2d9d700 1 --2- 172.21.15.50:0/3418300868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effb41216f0 0x7effb4121b20 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7effa40043a0 tx=0x7effa40108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:25.013 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.002+0000 7effa37fe700 1 -- 172.21.15.50:0/3418300868 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa4011830 con 0x7effb41216f0 2019-12-19T22:08:25.013 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.002+0000 7effb8819700 1 -- 172.21.15.50:0/3418300868 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effb40886e0 con 0x7effb41216f0 2019-12-19T22:08:25.014 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.002+0000 7effa37fe700 1 -- 172.21.15.50:0/3418300868 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7effa4011c10 con 0x7effb41216f0 2019-12-19T22:08:25.014 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.002+0000 7effb8819700 1 -- 172.21.15.50:0/3418300868 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effb4089250 con 0x7effb41216f0 2019-12-19T22:08:25.014 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.002+0000 7effb2d9d700 1 --2- 172.21.15.50:0/3418300868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effb41216f0 0x7effb4121b20 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7effa40043a0 tx=0x7effa40108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:25.014 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.002+0000 7effa37fe700 1 -- 172.21.15.50:0/3418300868 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7effa400b330 con 0x7effb41216f0 2019-12-19T22:08:25.014 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.002+0000 7effb2d9d700 1 --2- 172.21.15.50:0/3418300868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effb41216f0 0x7effb4121b20 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7effa40043a0 tx=0x7effa40108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:25.014 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.003+0000 7effa37fe700 1 --2- 172.21.15.50:0/3418300868 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7eff9801fab0 0x7eff98021fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:25.014 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.003+0000 7effa37fe700 1 -- 172.21.15.50:0/3418300868 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3786+0+0 (secure 0 0 0) 0x7effa402a4a0 con 0x7effb41216f0 2019-12-19T22:08:25.015 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.003+0000 7effb259c700 1 --2- 172.21.15.50:0/3418300868 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7eff9801fab0 0x7eff98021fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:25.015 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.003+0000 7effb259c700 1 --2- 172.21.15.50:0/3418300868 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7eff9801fab0 0x7eff98021fc0 crc :-1 s=READY pgs=59 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:25.015 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.003+0000 7effb8819700 1 -- 172.21.15.50:0/3418300868 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effb4056340 con 0x7effb41216f0 2019-12-19T22:08:25.015 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.006+0000 7effb2d9d700 1 --2- 172.21.15.50:0/3418300868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effb41216f0 0x7effb4121b20 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7effa40043a0 tx=0x7effa40108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:25.015 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.006+0000 7effa37fe700 1 -- 172.21.15.50:0/3418300868 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7effa400b640 con 0x7effb41216f0 2019-12-19T22:08:25.193 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.185+0000 7effb8819700 1 -- 172.21.15.50:0/3418300868 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7effb407b080 con 0x7effb41216f0 2019-12-19T22:08:25.193 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.185+0000 7effb2d9d700 1 --2- 172.21.15.50:0/3418300868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effb41216f0 0x7effb4121b20 secure :-1 s=THROTTLE_DONE pgs=241 cs=0 l=1 rx=0x7effa40043a0 tx=0x7effa40108f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:25.193 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.185+0000 7effa37fe700 1 -- 172.21.15.50:0/3418300868 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+1767 (secure 0 0 0) 0x7effa4007de0 con 0x7effb41216f0 2019-12-19T22:08:25.194 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.186+0000 7effb8819700 1 -- 172.21.15.50:0/3418300868 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7eff9801fab0 msgr2=0x7eff98021fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:25.194 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.186+0000 7effb8819700 1 --2- 172.21.15.50:0/3418300868 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7eff9801fab0 0x7eff98021fc0 crc :-1 s=READY pgs=59 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:25.194 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.186+0000 7effb8819700 1 -- 172.21.15.50:0/3418300868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effb41216f0 msgr2=0x7effb4121b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:25.194 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.186+0000 7effb8819700 1 --2- 172.21.15.50:0/3418300868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effb41216f0 0x7effb4121b20 secure :-1 s=READY pgs=241 cs=0 l=1 rx=0x7effa40043a0 tx=0x7effa40108f0).stop 2019-12-19T22:08:25.194 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.186+0000 7effb8819700 1 -- 172.21.15.50:0/3418300868 shutdown_connections 2019-12-19T22:08:25.194 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.186+0000 7effb8819700 1 --2- 172.21.15.50:0/3418300868 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7eff9801fab0 0x7eff98021fc0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:25.194 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.186+0000 7effb8819700 1 --2- 172.21.15.50:0/3418300868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7effb41216f0 0x7effb4121b20 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:25.195 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.186+0000 7effb8819700 1 -- 172.21.15.50:0/3418300868 shutdown_connections 2019-12-19T22:08:25.195 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.186+0000 7effb8819700 1 -- 172.21.15.50:0/3418300868 wait complete. 2019-12-19T22:08:25.195 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:25.186+0000 7effb8819700 1 -- 172.21.15.50:0/3418300868 >> 172.21.15.50:0/3418300868 conn(0x7effb4081c00 msgr2=0x7effb40805c0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:25.195 INFO:teuthology.orchestra.run.smithi050.stderr:dumped fsmap epoch 6 2019-12-19T22:08:25.195 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:08:25.205 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2019-12-19T22:08:06.710606+0000","modified":"2019-12-19T22:08:10.714748+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4186":{"gid":4186,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":2,"addr":"172.21.15.50:6827/1500608103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1500608103},{"type":"v1","addr":"172.21.15.50:6827","nonce":1500608103}]},"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2019-12-19T22:08:25.307 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4186}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 2, u'failed': [], u'epoch': 6, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [3], u'info': {u'gid_4186': {u'export_targets': [], u'name': u'a', u'incarnation': 5, u'state_seq': 2, u'state': u'up:active', u'gid': 4186, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'addrs': {u'addrvec': [{u'nonce': 1500608103, u'type': u'v2', u'addr': u'172.21.15.50:6826'}, {u'nonce': 1500608103, u'type': u'v1', u'addr': u'172.21.15.50:6827'}]}, u'addr': u'172.21.15.50:6827/1500608103'}}, u'fs_name': u'cephfs', u'created': u'2019-12-19T22:08:06.710606+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2019-12-19T22:08:10.714748+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2019-12-19T22:08:25.307 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2019-12-19T22:08:25.307 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok status 2019-12-19T22:08:25.437 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2019-12-19T22:08:25.438 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_fsid": "c1382993-41cc-4b35-a402-c17778701f01", 2019-12-19T22:08:25.438 INFO:teuthology.orchestra.run.smithi050.stdout: "whoami": 0, 2019-12-19T22:08:25.438 INFO:teuthology.orchestra.run.smithi050.stdout: "id": 4186, 2019-12-19T22:08:25.438 INFO:teuthology.orchestra.run.smithi050.stdout: "want_state": "up:active", 2019-12-19T22:08:25.439 INFO:teuthology.orchestra.run.smithi050.stdout: "state": "up:active", 2019-12-19T22:08:25.439 INFO:teuthology.orchestra.run.smithi050.stdout: "rank_uptime": 15.721838248999999, 2019-12-19T22:08:25.439 INFO:teuthology.orchestra.run.smithi050.stdout: "mdsmap_epoch": 6, 2019-12-19T22:08:25.439 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch": 25, 2019-12-19T22:08:25.439 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_epoch_barrier": 17, 2019-12-19T22:08:25.439 INFO:teuthology.orchestra.run.smithi050.stdout: "uptime": 16.366036322999999 2019-12-19T22:08:25.439 INFO:teuthology.orchestra.run.smithi050.stdout:} 2019-12-19T22:08:25.446 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "c1382993-41cc-4b35-a402-c17778701f01", "whoami": 0, "id": 4186, "want_state": "up:active", "state": "up:active", "rank_uptime": 15.721838248999999, "mdsmap_epoch": 6, "osdmap_epoch": 25, "osdmap_epoch_barrier": 17, "uptime": 16.366036322999999 } 2019-12-19T22:08:25.446 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2019-12-19T22:08:25.446 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2019-12-19T22:08:25.446 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi050.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2019-12-19T22:08:25.447 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-19T22:08:25.447 INFO:teuthology.orchestra.run.smithi050:> mkdir -p /home/ubuntu/cephtest/mnt.1 2019-12-19T22:08:25.467 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-19T22:08:25.468 INFO:teuthology.orchestra.run.smithi050:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2019-12-19T22:08:25.532 DEBUG:teuthology.orchestra.run:got remote process result: 32 2019-12-19T22:08:25.541 INFO:teuthology.orchestra.run.smithi050.stderr:mount: /sys/fs/fuse/connections: mount point does not exist. 2019-12-19T22:08:25.541 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-19T22:08:25.541 INFO:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2019-12-19T22:08:25.587 DEBUG:teuthology.orchestra.run:got remote process result: 2 2019-12-19T22:08:25.591 INFO:teuthology.orchestra.run.smithi050.stderr:ls: cannot access '/sys/fs/fuse/connections': No such file or directory 2019-12-19T22:08:25.591 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2019-12-19T22:08:25.592 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1 2019-12-19T22:08:25.629 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-19T22:08:25.630 INFO:teuthology.orchestra.run.smithi050:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2019-12-19T22:08:25.661 DEBUG:teuthology.orchestra.run:got remote process result: 32 2019-12-19T22:08:25.664 INFO:teuthology.orchestra.run.smithi050.stderr:mount: /sys/fs/fuse/connections: mount point does not exist. 2019-12-19T22:08:25.666 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-19T22:08:25.666 INFO:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2019-12-19T22:08:25.709 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi050.stderr:2019-12-19T22:08:25.707+0000 7f68cc40b040 -1 init, newargv = 0x55e798f329c0 newargc=7 2019-12-19T22:08:25.709 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi050.stderr:ceph-fuse[30540]: starting ceph client 2019-12-19T22:08:25.717 DEBUG:teuthology.orchestra.run:got remote process result: 2 2019-12-19T22:08:25.723 INFO:teuthology.orchestra.run.smithi050.stderr:ls: cannot access '/sys/fs/fuse/connections': No such file or directory 2019-12-19T22:08:25.740 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi050.stderr:ceph-fuse[30540]: starting fuse 2019-12-19T22:08:26.824 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-19T22:08:26.825 INFO:teuthology.orchestra.run.smithi050:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2019-12-19T22:08:26.892 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-19T22:08:26.893 INFO:teuthology.orchestra.run.smithi050:> ls /sys/fs/fuse/connections 2019-12-19T22:08:26.936 INFO:teuthology.orchestra.run.smithi050.stdout:44 2019-12-19T22:08:26.936 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2019-12-19T22:08:26.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2019-12-19T22:08:26.937 INFO:teuthology.orchestra.run.smithi050:> sudo python2 -c ' 2019-12-19T22:08:26.937 INFO:teuthology.orchestra.run.smithi050:> import glob 2019-12-19T22:08:26.937 INFO:teuthology.orchestra.run.smithi050:> import re 2019-12-19T22:08:26.937 INFO:teuthology.orchestra.run.smithi050:> import os 2019-12-19T22:08:26.937 INFO:teuthology.orchestra.run.smithi050:> import subprocess 2019-12-19T22:08:26.937 INFO:teuthology.orchestra.run.smithi050:> 2019-12-19T22:08:26.937 INFO:teuthology.orchestra.run.smithi050:> def find_socket(client_name): 2019-12-19T22:08:26.939 INFO:teuthology.orchestra.run.smithi050:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2019-12-19T22:08:26.939 INFO:teuthology.orchestra.run.smithi050:> files = glob.glob(asok_path) 2019-12-19T22:08:26.939 INFO:teuthology.orchestra.run.smithi050:> 2019-12-19T22:08:26.941 INFO:teuthology.orchestra.run.smithi050:> # Given a non-glob path, it better be there 2019-12-19T22:08:26.941 INFO:teuthology.orchestra.run.smithi050:> if "*" not in asok_path: 2019-12-19T22:08:26.941 INFO:teuthology.orchestra.run.smithi050:> assert(len(files) == 1) 2019-12-19T22:08:26.941 INFO:teuthology.orchestra.run.smithi050:> return files[0] 2019-12-19T22:08:26.941 INFO:teuthology.orchestra.run.smithi050:> 2019-12-19T22:08:26.942 INFO:teuthology.orchestra.run.smithi050:> for f in files: 2019-12-19T22:08:26.942 INFO:teuthology.orchestra.run.smithi050:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2019-12-19T22:08:26.942 INFO:teuthology.orchestra.run.smithi050:> if os.path.exists("/proc/{0}".format(pid)): 2019-12-19T22:08:26.942 INFO:teuthology.orchestra.run.smithi050:> return f 2019-12-19T22:08:26.943 INFO:teuthology.orchestra.run.smithi050:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2019-12-19T22:08:26.943 INFO:teuthology.orchestra.run.smithi050:> 2019-12-19T22:08:26.943 INFO:teuthology.orchestra.run.smithi050:> print(find_socket("client.1")) 2019-12-19T22:08:26.943 INFO:teuthology.orchestra.run.smithi050:> ' 2019-12-19T22:08:26.997 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-12-19T22:08:27.001 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: python2: command not found 2019-12-19T22:08:27.001 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 89, in run_tasks manager.__enter__() File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/home/teuthworker/src/github.com_ceph_ceph-c_wip-sjust-read-from-replica/qa/tasks/ceph_fuse.py", line 135, in task mount.mount() File "/home/teuthworker/src/github.com_ceph_ceph-c_wip-sjust-read-from-replica/qa/tasks/cephfs/fuse_mount.py", line 33, in mount return self._mount(mount_path, mount_fs_name) File "/home/teuthworker/src/github.com_ceph_ceph-c_wip-sjust-read-from-replica/qa/tasks/cephfs/fuse_mount.py", line 158, in _mount self.gather_mount_info() File "/home/teuthworker/src/github.com_ceph_ceph-c_wip-sjust-read-from-replica/qa/tasks/cephfs/fuse_mount.py", line 161, in gather_mount_info status = self.admin_socket(['status']) File "/home/teuthworker/src/github.com_ceph_ceph-c_wip-sjust-read-from-replica/qa/tasks/cephfs/fuse_mount.py", line 440, in admin_socket ], stdout=StringIO(), timeout=(15*60)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 198, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 433, in run r.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 158, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 180, in _raise_for_status node=self.hostname, label=self.label CommandFailedError: Command failed on smithi050 with status 1: 'sudo python2 -c \'\nimport glob\nimport re\nimport os\nimport subprocess\n\ndef find_socket(client_name):\n asok_path = "/var/run/ceph/ceph-client.1.*.asok"\n files = glob.glob(asok_path)\n\n # Given a non-glob path, it better be there\n if "*" not in asok_path:\n assert(len(files) == 1)\n return files[0]\n\n for f in files:\n pid = re.match(".*\\.(\\d+)\\.asok$", f).group(1)\n if os.path.exists("/proc/{0}".format(pid)):\n return f\n raise RuntimeError("Client socket {0} not found".format(client_name))\n\nprint(find_socket("client.1"))\n\'' 2019-12-19T22:08:27.002 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2019-12-19T22:08:27.015 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2019-12-19T22:08:27.031 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2019-12-19T22:08:27.032 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-12-19T22:08:27.163 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.155+0000 7f5cb5c4b700 1 Processor -- start 2019-12-19T22:08:27.163 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.155+0000 7f5cb5c4b700 1 -- start start 2019-12-19T22:08:27.163 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.155+0000 7f5cb5c4b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5cb00898b0 0x7f5cb0081170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:27.163 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.155+0000 7f5cb5c4b700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cb0089ce0 con 0x7f5cb0089480 2019-12-19T22:08:27.164 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.155+0000 7f5cb5c4b700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cb008ae60 con 0x7f5cb00898b0 2019-12-19T22:08:27.164 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.155+0000 7f5ca7fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5cb00898b0 0x7f5cb0081170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:27.164 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.156+0000 7f5ca7fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5cb00898b0 0x7f5cb0081170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53930/0 (socket says 172.21.15.50:53930) 2019-12-19T22:08:27.164 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.156+0000 7f5ca7fff700 1 -- 172.21.15.50:0/887494052 learned_addr learned my addr 172.21.15.50:0/887494052 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:27.164 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.156+0000 7f5ca7fff700 1 -- 172.21.15.50:0/887494052 >> v1:172.21.15.50:6789/0 conn(0x7f5cb0089480 legacy=0x7f5cb008f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:27.164 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.156+0000 7f5ca7fff700 1 -- 172.21.15.50:0/887494052 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb008edb0 con 0x7f5cb00898b0 2019-12-19T22:08:27.165 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.156+0000 7f5ca7fff700 1 --2- 172.21.15.50:0/887494052 >> v2:172.21.15.50:3300/0 conn(0x7f5cb00898b0 0x7f5cb0081170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5c98008790 tx=0x7f5c9800fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:27.165 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.156+0000 7f5ca7fff700 1 --2- 172.21.15.50:0/887494052 >> v2:172.21.15.50:3300/0 conn(0x7f5cb00898b0 0x7f5cb0081170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5c98008790 tx=0x7f5c9800fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:27.165 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.156+0000 7f5ca7fff700 1 --2- 172.21.15.50:0/887494052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cb00898b0 0x7f5cb0081170 secure :-1 s=READY pgs=247 cs=0 l=1 rx=0x7f5c98008790 tx=0x7f5c9800fcb0).ready entity=mon.0 client_cookie=22f832f19dd0f57a server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:27.165 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.156+0000 7f5ca7fff700 1 --2- 172.21.15.50:0/887494052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cb00898b0 0x7f5cb0081170 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7f5c98008790 tx=0x7f5c9800fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:27.165 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.156+0000 7f5caf7fe700 1 -- 172.21.15.50:0/887494052 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f5c98011330 con 0x7f5cb00898b0 2019-12-19T22:08:27.165 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.156+0000 7f5ca7fff700 1 --2- 172.21.15.50:0/887494052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cb00898b0 0x7f5cb0081170 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7f5c98008790 tx=0x7f5c9800fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:27.166 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.156+0000 7f5ca7fff700 1 --2- 172.21.15.50:0/887494052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cb00898b0 0x7f5cb0081170 secure :-1 s=THROTTLE_DONE pgs=247 cs=0 l=1 rx=0x7f5c98008790 tx=0x7f5c9800fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:27.166 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.156+0000 7f5caf7fe700 1 -- 172.21.15.50:0/887494052 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c98011530 con 0x7f5cb00898b0 2019-12-19T22:08:27.167 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.156+0000 7f5caf7fe700 1 -- 172.21.15.50:0/887494052 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f5c98011850 con 0x7f5cb00898b0 2019-12-19T22:08:27.167 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.156+0000 7f5cb5c4b700 1 -- 172.21.15.50:0/887494052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cb00898b0 msgr2=0x7f5cb0081170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:27.167 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.156+0000 7f5cb5c4b700 1 --2- 172.21.15.50:0/887494052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cb00898b0 0x7f5cb0081170 secure :-1 s=READY pgs=247 cs=0 l=1 rx=0x7f5c98008790 tx=0x7f5c9800fcb0).stop 2019-12-19T22:08:27.167 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.157+0000 7f5cb5c4b700 1 -- 172.21.15.50:0/887494052 shutdown_connections 2019-12-19T22:08:27.167 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.157+0000 7f5cb5c4b700 1 --2- 172.21.15.50:0/887494052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cb00898b0 0x7f5cb0081170 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:27.168 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.157+0000 7f5cb5c4b700 1 -- 172.21.15.50:0/887494052 shutdown_connections 2019-12-19T22:08:27.168 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.157+0000 7f5cb5c4b700 1 -- 172.21.15.50:0/887494052 wait complete. 2019-12-19T22:08:27.168 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.157+0000 7f5cb5c4b700 1 -- 172.21.15.50:0/887494052 >> 172.21.15.50:0/887494052 conn(0x7f5cb0067e70 msgr2=0x7f5cb0094570 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:27.168 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.158+0000 7f5cb5c4b700 1 Processor -- start 2019-12-19T22:08:27.168 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.158+0000 7f5cb5c4b700 1 -- start start 2019-12-19T22:08:27.168 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.158+0000 7f5cb5c4b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f5cb01219e0 0x7f5cb0123e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:27.169 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.158+0000 7f5cb5c4b700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cb00845c0 con 0x7f5cb00824d0 2019-12-19T22:08:27.169 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.158+0000 7f5cb5c4b700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cb00892b0 con 0x7f5cb01219e0 2019-12-19T22:08:27.169 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.158+0000 7f5caffff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f5cb00824d0 0x7f5cb0082900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40060/0 (socket says 172.21.15.50:40060) 2019-12-19T22:08:27.169 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.158+0000 7f5caffff700 1 -- 172.21.15.50:0/1092783393 learned_addr learned my addr 172.21.15.50:0/1092783393 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:27.169 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.158+0000 7f5ca7fff700 1 --2- 172.21.15.50:0/1092783393 >> v2:172.21.15.50:3300/0 conn(0x7f5cb01219e0 0x7f5cb0123e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:27.169 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.159+0000 7f5ca7fff700 1 -- 172.21.15.50:0/1092783393 >> v1:172.21.15.50:6789/0 conn(0x7f5cb00824d0 legacy=0x7f5cb0082900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:27.170 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.159+0000 7f5ca7fff700 1 -- 172.21.15.50:0/1092783393 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb0083db0 con 0x7f5cb01219e0 2019-12-19T22:08:27.170 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.159+0000 7f5ca7fff700 1 --2- 172.21.15.50:0/1092783393 >> v2:172.21.15.50:3300/0 conn(0x7f5cb01219e0 0x7f5cb0123e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5c98008790 tx=0x7f5c9800f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:27.170 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.159+0000 7f5ca7fff700 1 --2- 172.21.15.50:0/1092783393 >> v2:172.21.15.50:3300/0 conn(0x7f5cb01219e0 0x7f5cb0123e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5c98008790 tx=0x7f5c9800f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:27.170 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.159+0000 7f5ca7fff700 1 --2- 172.21.15.50:0/1092783393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cb01219e0 0x7f5cb0123e20 secure :-1 s=READY pgs=249 cs=0 l=1 rx=0x7f5c98008790 tx=0x7f5c9800f780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:27.170 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.159+0000 7f5ca7fff700 1 --2- 172.21.15.50:0/1092783393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cb01219e0 0x7f5cb0123e20 secure :-1 s=THROTTLE_DONE pgs=249 cs=0 l=1 rx=0x7f5c98008790 tx=0x7f5c9800f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:27.170 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.159+0000 7f5ca7fff700 1 --2- 172.21.15.50:0/1092783393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cb01219e0 0x7f5cb0123e20 secure :-1 s=THROTTLE_DONE pgs=249 cs=0 l=1 rx=0x7f5c98008790 tx=0x7f5c9800f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:27.171 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.159+0000 7f5cad7fa700 1 -- 172.21.15.50:0/1092783393 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f5c98007280 con 0x7f5cb01219e0 2019-12-19T22:08:27.171 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.159+0000 7f5ca7fff700 1 --2- 172.21.15.50:0/1092783393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cb01219e0 0x7f5cb0123e20 secure :-1 s=THROTTLE_DONE pgs=249 cs=0 l=1 rx=0x7f5c98008790 tx=0x7f5c9800f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:27.171 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.159+0000 7f5cad7fa700 1 -- 172.21.15.50:0/1092783393 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c980115c0 con 0x7f5cb01219e0 2019-12-19T22:08:27.171 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.159+0000 7f5cad7fa700 1 -- 172.21.15.50:0/1092783393 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f5c980118e0 con 0x7f5cb01219e0 2019-12-19T22:08:27.171 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.159+0000 7f5cb5c4b700 1 -- 172.21.15.50:0/1092783393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cb0085d80 con 0x7f5cb01219e0 2019-12-19T22:08:27.172 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.159+0000 7f5cb5c4b700 1 -- 172.21.15.50:0/1092783393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cb0085440 con 0x7f5cb01219e0 2019-12-19T22:08:27.172 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.159+0000 7f5ca7fff700 1 --2- 172.21.15.50:0/1092783393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cb01219e0 0x7f5cb0123e20 secure :-1 s=THROTTLE_DONE pgs=249 cs=0 l=1 rx=0x7f5c98008790 tx=0x7f5c9800f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:27.172 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.159+0000 7f5cad7fa700 1 -- 172.21.15.50:0/1092783393 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7f5c98005540 con 0x7f5cb01219e0 2019-12-19T22:08:27.172 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.159+0000 7f5ca7fff700 1 --2- 172.21.15.50:0/1092783393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cb01219e0 0x7f5cb0123e20 secure :-1 s=THROTTLE_DONE pgs=249 cs=0 l=1 rx=0x7f5c98008790 tx=0x7f5c9800f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:27.174 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.160+0000 7f5cad7fa700 1 --2- 172.21.15.50:0/1092783393 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f5c9401fa80 0x7f5c94021f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:27.175 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.160+0000 7f5cad7fa700 1 -- 172.21.15.50:0/1092783393 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3786+0+0 (secure 0 0 0) 0x7f5c9802aa90 con 0x7f5cb01219e0 2019-12-19T22:08:27.175 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.160+0000 7f5caffff700 1 --2- 172.21.15.50:0/1092783393 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f5c9401fa80 0x7f5c94021f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:27.175 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.160+0000 7f5caffff700 1 --2- 172.21.15.50:0/1092783393 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f5c9401fa80 0x7f5c94021f90 crc :-1 s=READY pgs=60 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:27.175 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.160+0000 7f5cb5c4b700 1 -- 172.21.15.50:0/1092783393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cb0056340 con 0x7f5cb01219e0 2019-12-19T22:08:27.176 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.163+0000 7f5ca7fff700 1 --2- 172.21.15.50:0/1092783393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cb01219e0 0x7f5cb0123e20 secure :-1 s=THROTTLE_DONE pgs=249 cs=0 l=1 rx=0x7f5c98008790 tx=0x7f5c9800f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:27.176 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.163+0000 7f5cad7fa700 1 -- 172.21.15.50:0/1092783393 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7f5c98005d70 con 0x7f5cb01219e0 2019-12-19T22:08:27.302 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.300+0000 7f5cb5c4b700 1 -- 172.21.15.50:0/1092783393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5cb0086060 con 0x7f5cb01219e0 2019-12-19T22:08:27.303 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.300+0000 7f5ca7fff700 1 --2- 172.21.15.50:0/1092783393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cb01219e0 0x7f5cb0123e20 secure :-1 s=THROTTLE_DONE pgs=249 cs=0 l=1 rx=0x7f5c98008790 tx=0x7f5c9800f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:27.303 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.300+0000 7f5cad7fa700 1 -- 172.21.15.50:0/1092783393 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+10340 (secure 0 0 0) 0x7f5c98005850 con 0x7f5cb01219e0 2019-12-19T22:08:27.303 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:08:27.304 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"c1382993-41cc-4b35-a402-c17778701f01","created":"2019-12-19T22:07:52.345475+0000","modified":"2019-12-19T22:08:23.402450+0000","last_up_change":"2019-12-19T22:07:58.357117+0000","last_in_change":"2019-12-19T22:07:58.357117+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-19T22:08:01.570202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2019-12-19T22:08:04.515784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2019-12-19T22:08:05.689151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"21","last_force_op_resend_prenautilus":"21","last_force_op_resend_preluminous":"21","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[4],"tier_of":-1,"read_tier":4,"write_tier":4,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"data_cache","create_time":"2019-12-19T22:08:16.355664+0000","flags":9,"flags_names":"hashpspool,incomplete_clones","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":4,"pg_placement_num":4,"pg_placement_num_target":4,"pg_num_target":4,"pg_num_pending":4,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"21","last_force_op_resend_prenautilus":"21","last_force_op_resend_preluminous":"21","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":3,"read_tier":-1,"write_tier":-1,"cache_mode":"writeback","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"bloom","false_positive_probability":0.050000000000000003,"target_size":0,"seed":0},"hit_set_period":3600,"hit_set_count":8,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{}}],"osds":[{"osd":0,"uuid":"6137ed8c-8e2c-4e88-8634-dc763bed14c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":27757},{"type":"v1","addr":"172.21.15.50:6817","nonce":27757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":27757},{"type":"v1","addr":"172.21.15.50:6819","nonce":27757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":27757},{"type":"v1","addr":"172.21.15.50:6823","nonce":27757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":27757},{"type":"v1","addr":"172.21.15.50:6821","nonce":27757}]},"public_addr":"172.21.15.50:6817/27757","cluster_addr":"172.21.15.50:6819/27757","heartbeat_back_addr":"172.21.15.50:6823/27757","heartbeat_front_addr":"172.21.15.50:6821/27757","state":["exists","up"]},{"osd":1,"uuid":"57d4e31d-408e-4302-859d-7ea672b93772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":27758},{"type":"v1","addr":"172.21.15.50:6801","nonce":27758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":27758},{"type":"v1","addr":"172.21.15.50:6803","nonce":27758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":27758},{"type":"v1","addr":"172.21.15.50:6810","nonce":27758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6805","nonce":27758},{"type":"v1","addr":"172.21.15.50:6807","nonce":27758}]},"public_addr":"172.21.15.50:6801/27758","cluster_addr":"172.21.15.50:6803/27758","heartbeat_back_addr":"172.21.15.50:6810/27758","heartbeat_front_addr":"172.21.15.50:6807/27758","state":["exists","up"]},{"osd":2,"uuid":"600ea585-aa50-4596-9b14-090eab15f9a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":27759},{"type":"v1","addr":"172.21.15.50:6806","nonce":27759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":27759},{"type":"v1","addr":"172.21.15.50:6811","nonce":27759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":27759},{"type":"v1","addr":"172.21.15.50:6816","nonce":27759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":27759},{"type":"v1","addr":"172.21.15.50:6813","nonce":27759}]},"public_addr":"172.21.15.50:6806/27759","cluster_addr":"172.21.15.50:6811/27759","heartbeat_back_addr":"172.21.15.50:6816/27759","heartbeat_front_addr":"172.21.15.50:6813/27759","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-19T22:07:56.415731+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-19T22:07:56.346062+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-19T22:07:56.090889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-19T22:08:27.305 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.301+0000 7f5cb5c4b700 1 -- 172.21.15.50:0/1092783393 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f5c9401fa80 msgr2=0x7f5c94021f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:27.305 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.301+0000 7f5cb5c4b700 1 --2- 172.21.15.50:0/1092783393 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f5c9401fa80 0x7f5c94021f90 crc :-1 s=READY pgs=60 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:27.305 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.301+0000 7f5cb5c4b700 1 -- 172.21.15.50:0/1092783393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cb01219e0 msgr2=0x7f5cb0123e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:27.305 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.301+0000 7f5cb5c4b700 1 --2- 172.21.15.50:0/1092783393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cb01219e0 0x7f5cb0123e20 secure :-1 s=READY pgs=249 cs=0 l=1 rx=0x7f5c98008790 tx=0x7f5c9800f780).stop 2019-12-19T22:08:27.305 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.301+0000 7f5cb5c4b700 1 -- 172.21.15.50:0/1092783393 shutdown_connections 2019-12-19T22:08:27.306 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.301+0000 7f5cb5c4b700 1 --2- 172.21.15.50:0/1092783393 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f5c9401fa80 0x7f5c94021f90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:27.306 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.301+0000 7f5cb5c4b700 1 --2- 172.21.15.50:0/1092783393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5cb01219e0 0x7f5cb0123e20 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:27.306 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.301+0000 7f5cb5c4b700 1 -- 172.21.15.50:0/1092783393 shutdown_connections 2019-12-19T22:08:27.306 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.301+0000 7f5cb5c4b700 1 -- 172.21.15.50:0/1092783393 wait complete. 2019-12-19T22:08:27.306 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.302+0000 7f5cb5c4b700 1 -- 172.21.15.50:0/1092783393 >> 172.21.15.50:0/1092783393 conn(0x7f5cb0091150 msgr2=0x7f5cb007ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:27.315 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2019-12-19T22:08:27.445 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.428+0000 7fa3f1dee700 1 Processor -- start 2019-12-19T22:08:27.445 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.428+0000 7fa3f1dee700 1 -- start start 2019-12-19T22:08:27.445 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.428+0000 7fa3f1dee700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa3ec0898b0 0x7fa3ec081170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:27.446 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.428+0000 7fa3f1dee700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3ec089ce0 con 0x7fa3ec089480 2019-12-19T22:08:27.446 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.428+0000 7fa3f1dee700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3ec08ae60 con 0x7fa3ec0898b0 2019-12-19T22:08:27.446 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.428+0000 7fa3e3fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa3ec0898b0 0x7fa3ec081170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:27.446 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.428+0000 7fa3e3fff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa3ec0898b0 0x7fa3ec081170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53938/0 (socket says 172.21.15.50:53938) 2019-12-19T22:08:27.446 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.428+0000 7fa3e3fff700 1 -- 172.21.15.50:0/4168783242 learned_addr learned my addr 172.21.15.50:0/4168783242 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:27.447 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.429+0000 7fa3e3fff700 1 -- 172.21.15.50:0/4168783242 >> v1:172.21.15.50:6789/0 conn(0x7fa3ec089480 legacy=0x7fa3ec08f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:27.447 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.429+0000 7fa3e3fff700 1 -- 172.21.15.50:0/4168783242 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3ec08edb0 con 0x7fa3ec0898b0 2019-12-19T22:08:27.447 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.429+0000 7fa3e3fff700 1 --2- 172.21.15.50:0/4168783242 >> v2:172.21.15.50:3300/0 conn(0x7fa3ec0898b0 0x7fa3ec081170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa3d4008790 tx=0x7fa3d400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:27.447 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.429+0000 7fa3e3fff700 1 --2- 172.21.15.50:0/4168783242 >> v2:172.21.15.50:3300/0 conn(0x7fa3ec0898b0 0x7fa3ec081170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa3d4008790 tx=0x7fa3d400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:27.449 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.429+0000 7fa3e3fff700 1 --2- 172.21.15.50:0/4168783242 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3ec0898b0 0x7fa3ec081170 secure :-1 s=READY pgs=251 cs=0 l=1 rx=0x7fa3d4008790 tx=0x7fa3d400fcb0).ready entity=mon.0 client_cookie=45aaa2b3f4967217 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:27.449 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.429+0000 7fa3e3fff700 1 --2- 172.21.15.50:0/4168783242 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3ec0898b0 0x7fa3ec081170 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7fa3d4008790 tx=0x7fa3d400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:27.450 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.429+0000 7fa3eb7fe700 1 -- 172.21.15.50:0/4168783242 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fa3d4011330 con 0x7fa3ec0898b0 2019-12-19T22:08:27.450 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.429+0000 7fa3e3fff700 1 --2- 172.21.15.50:0/4168783242 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3ec0898b0 0x7fa3ec081170 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7fa3d4008790 tx=0x7fa3d400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:27.450 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.429+0000 7fa3e3fff700 1 --2- 172.21.15.50:0/4168783242 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3ec0898b0 0x7fa3ec081170 secure :-1 s=THROTTLE_DONE pgs=251 cs=0 l=1 rx=0x7fa3d4008790 tx=0x7fa3d400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:27.450 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.429+0000 7fa3eb7fe700 1 -- 172.21.15.50:0/4168783242 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d4011530 con 0x7fa3ec0898b0 2019-12-19T22:08:27.450 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.429+0000 7fa3eb7fe700 1 -- 172.21.15.50:0/4168783242 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fa3d4011850 con 0x7fa3ec0898b0 2019-12-19T22:08:27.450 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.429+0000 7fa3f1dee700 1 -- 172.21.15.50:0/4168783242 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3ec0898b0 msgr2=0x7fa3ec081170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:27.451 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.429+0000 7fa3f1dee700 1 --2- 172.21.15.50:0/4168783242 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3ec0898b0 0x7fa3ec081170 secure :-1 s=READY pgs=251 cs=0 l=1 rx=0x7fa3d4008790 tx=0x7fa3d400fcb0).stop 2019-12-19T22:08:27.451 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.429+0000 7fa3f1dee700 1 -- 172.21.15.50:0/4168783242 shutdown_connections 2019-12-19T22:08:27.451 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.429+0000 7fa3f1dee700 1 --2- 172.21.15.50:0/4168783242 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3ec0898b0 0x7fa3ec081170 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:27.451 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.429+0000 7fa3f1dee700 1 -- 172.21.15.50:0/4168783242 shutdown_connections 2019-12-19T22:08:27.451 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.429+0000 7fa3f1dee700 1 -- 172.21.15.50:0/4168783242 wait complete. 2019-12-19T22:08:27.451 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.429+0000 7fa3f1dee700 1 -- 172.21.15.50:0/4168783242 >> 172.21.15.50:0/4168783242 conn(0x7fa3ec067e70 msgr2=0x7fa3ec094570 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:27.451 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.430+0000 7fa3f1dee700 1 Processor -- start 2019-12-19T22:08:27.452 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.430+0000 7fa3f1dee700 1 -- start start 2019-12-19T22:08:27.452 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.431+0000 7fa3f1dee700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fa3ec11f830 0x7fa3ec11fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:27.452 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.431+0000 7fa3f1dee700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3ec1205e0 con 0x7fa3ec1201b0 2019-12-19T22:08:27.452 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.431+0000 7fa3f1dee700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3ec090a20 con 0x7fa3ec11f830 2019-12-19T22:08:27.452 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.431+0000 7fa3e3fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fa3ec1201b0 0x7fa3ec084620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40070/0 (socket says 172.21.15.50:40070) 2019-12-19T22:08:27.452 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.431+0000 7fa3e3fff700 1 -- 172.21.15.50:0/3003439149 learned_addr learned my addr 172.21.15.50:0/3003439149 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:27.452 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.431+0000 7fa3ebfff700 1 --2- 172.21.15.50:0/3003439149 >> v2:172.21.15.50:3300/0 conn(0x7fa3ec11f830 0x7fa3ec11fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:27.453 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.431+0000 7fa3e97fa700 1 -- 172.21.15.50:0/3003439149 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2286189251 0 0) 0x7fa3ec1205e0 con 0x7fa3ec1201b0 2019-12-19T22:08:27.453 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.431+0000 7fa3e97fa700 1 -- 172.21.15.50:0/3003439149 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3d00030b0 con 0x7fa3ec1201b0 2019-12-19T22:08:27.453 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.431+0000 7fa3ebfff700 1 -- 172.21.15.50:0/3003439149 >> v1:172.21.15.50:6789/0 conn(0x7fa3ec1201b0 legacy=0x7fa3ec084620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:27.453 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.431+0000 7fa3ebfff700 1 -- 172.21.15.50:0/3003439149 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3ec0874b0 con 0x7fa3ec11f830 2019-12-19T22:08:27.453 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.431+0000 7fa3ebfff700 1 --2- 172.21.15.50:0/3003439149 >> v2:172.21.15.50:3300/0 conn(0x7fa3ec11f830 0x7fa3ec11fc60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa3dc0013e0 tx=0x7fa3dc00c2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:27.453 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.431+0000 7fa3ebfff700 1 --2- 172.21.15.50:0/3003439149 >> v2:172.21.15.50:3300/0 conn(0x7fa3ec11f830 0x7fa3ec11fc60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa3dc0013e0 tx=0x7fa3dc00c2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:27.453 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.431+0000 7fa3ebfff700 1 --2- 172.21.15.50:0/3003439149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3ec11f830 0x7fa3ec11fc60 secure :-1 s=READY pgs=253 cs=0 l=1 rx=0x7fa3dc0013e0 tx=0x7fa3dc00c2f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:27.454 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.431+0000 7fa3ebfff700 1 --2- 172.21.15.50:0/3003439149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3ec11f830 0x7fa3ec11fc60 secure :-1 s=THROTTLE_DONE pgs=253 cs=0 l=1 rx=0x7fa3dc0013e0 tx=0x7fa3dc00c2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:27.454 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.431+0000 7fa3e97fa700 1 -- 172.21.15.50:0/3003439149 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fa3dc00ca10 con 0x7fa3ec11f830 2019-12-19T22:08:27.454 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.431+0000 7fa3ebfff700 1 --2- 172.21.15.50:0/3003439149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3ec11f830 0x7fa3ec11fc60 secure :-1 s=THROTTLE_DONE pgs=253 cs=0 l=1 rx=0x7fa3dc0013e0 tx=0x7fa3dc00c2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:27.454 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.431+0000 7fa3e97fa700 1 -- 172.21.15.50:0/3003439149 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3dc00cc10 con 0x7fa3ec11f830 2019-12-19T22:08:27.454 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.431+0000 7fa3ebfff700 1 --2- 172.21.15.50:0/3003439149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3ec11f830 0x7fa3ec11fc60 secure :-1 s=THROTTLE_DONE pgs=253 cs=0 l=1 rx=0x7fa3dc0013e0 tx=0x7fa3dc00c2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:27.454 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.432+0000 7fa3f1dee700 1 -- 172.21.15.50:0/3003439149 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3ec085ac0 con 0x7fa3ec11f830 2019-12-19T22:08:27.454 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.432+0000 7fa3e97fa700 1 -- 172.21.15.50:0/3003439149 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fa3dc010e40 con 0x7fa3ec11f830 2019-12-19T22:08:27.455 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.432+0000 7fa3f1dee700 1 -- 172.21.15.50:0/3003439149 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3ec086590 con 0x7fa3ec11f830 2019-12-19T22:08:27.455 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.432+0000 7fa3ebfff700 1 --2- 172.21.15.50:0/3003439149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3ec11f830 0x7fa3ec11fc60 secure :-1 s=THROTTLE_DONE pgs=253 cs=0 l=1 rx=0x7fa3dc0013e0 tx=0x7fa3dc00c2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:27.455 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.432+0000 7fa3e97fa700 1 -- 172.21.15.50:0/3003439149 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7fa3dc007430 con 0x7fa3ec11f830 2019-12-19T22:08:27.455 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.432+0000 7fa3ebfff700 1 --2- 172.21.15.50:0/3003439149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3ec11f830 0x7fa3ec11fc60 secure :-1 s=THROTTLE_DONE pgs=253 cs=0 l=1 rx=0x7fa3dc0013e0 tx=0x7fa3dc00c2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:27.455 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.432+0000 7fa3e97fa700 1 --2- 172.21.15.50:0/3003439149 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fa3d001ffd0 0x7fa3d00224e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:27.455 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.432+0000 7fa3e97fa700 1 -- 172.21.15.50:0/3003439149 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3786+0+0 (secure 0 0 0) 0x7fa3dc02a540 con 0x7fa3ec11f830 2019-12-19T22:08:27.459 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.432+0000 7fa3e3fff700 1 --2- 172.21.15.50:0/3003439149 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fa3d001ffd0 0x7fa3d00224e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:27.459 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.433+0000 7fa3e3fff700 1 --2- 172.21.15.50:0/3003439149 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fa3d001ffd0 0x7fa3d00224e0 crc :-1 s=READY pgs=61 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:27.460 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.433+0000 7fa3f1dee700 1 -- 172.21.15.50:0/3003439149 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3ec056340 con 0x7fa3ec11f830 2019-12-19T22:08:27.460 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.436+0000 7fa3ebfff700 1 --2- 172.21.15.50:0/3003439149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3ec11f830 0x7fa3ec11fc60 secure :-1 s=THROTTLE_DONE pgs=253 cs=0 l=1 rx=0x7fa3dc0013e0 tx=0x7fa3dc00c2f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:27.460 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.436+0000 7fa3e97fa700 1 -- 172.21.15.50:0/3003439149 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7fa3dc00b1b0 con 0x7fa3ec11f830 2019-12-19T22:08:27.570 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.568+0000 7fa3f1dee700 1 -- 172.21.15.50:0/3003439149 --> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa3ec082200 con 0x7fa3d001ffd0 2019-12-19T22:08:27.574 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.570+0000 7fa3e97fa700 1 -- 172.21.15.50:0/3003439149 <== mgr.4103 v2:172.21.15.50:6824/27190 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+74180 (crc 0 0 0) 0x7fa3ec082200 con 0x7fa3d001ffd0 2019-12-19T22:08:27.574 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.571+0000 7fa3f1dee700 1 -- 172.21.15.50:0/3003439149 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fa3d001ffd0 msgr2=0x7fa3d00224e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:27.574 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.571+0000 7fa3f1dee700 1 --2- 172.21.15.50:0/3003439149 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fa3d001ffd0 0x7fa3d00224e0 crc :-1 s=READY pgs=61 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:27.574 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.571+0000 7fa3f1dee700 1 -- 172.21.15.50:0/3003439149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3ec11f830 msgr2=0x7fa3ec11fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:27.574 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.571+0000 7fa3f1dee700 1 --2- 172.21.15.50:0/3003439149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3ec11f830 0x7fa3ec11fc60 secure :-1 s=READY pgs=253 cs=0 l=1 rx=0x7fa3dc0013e0 tx=0x7fa3dc00c2f0).stop 2019-12-19T22:08:27.575 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.571+0000 7fa3f1dee700 1 -- 172.21.15.50:0/3003439149 shutdown_connections 2019-12-19T22:08:27.575 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.571+0000 7fa3f1dee700 1 --2- 172.21.15.50:0/3003439149 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fa3d001ffd0 0x7fa3d00224e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:27.575 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.571+0000 7fa3f1dee700 1 --2- 172.21.15.50:0/3003439149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3ec11f830 0x7fa3ec11fc60 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:27.575 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.571+0000 7fa3f1dee700 1 -- 172.21.15.50:0/3003439149 shutdown_connections 2019-12-19T22:08:27.575 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.571+0000 7fa3f1dee700 1 -- 172.21.15.50:0/3003439149 wait complete. 2019-12-19T22:08:27.575 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.571+0000 7fa3f1dee700 1 -- 172.21.15.50:0/3003439149 >> 172.21.15.50:0/3003439149 conn(0x7fa3ec091150 msgr2=0x7fa3ec07ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:27.575 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:08:27.576 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2019-12-19T22:08:27.584 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2019-12-19T22:08:25.890155+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":56,"acting":56,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":56,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":3146400,"kb_used_data":648,"kb_used_omap":0,"kb_used_meta":3145728,"kb_avail":311426400,"statfs":{"total":322122547200,"available":318900633600,"internally_reserved":3221225472,"allocated":663552,"data_stored":223241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3221225472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.492115"},"pg_stats":[{"pgid":"4.0","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-19T22:08:21.521920+0000","last_change":"2019-12-19T22:08:17.394356+0000","last_active":"2019-12-19T22:08:21.521920+0000","last_peered":"2019-12-19T22:08:21.521920+0000","last_clean":"2019-12-19T22:08:21.521920+0000","last_became_active":"2019-12-19T22:08:17.393620+0000","last_became_peered":"2019-12-19T22:08:17.393620+0000","last_unstale":"2019-12-19T22:08:21.521920+0000","last_undegraded":"2019-12-19T22:08:21.521920+0000","last_fullsized":"2019-12-19T22:08:21.521920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:16.385696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:16.385696+0000","last_clean_scrub_stamp":"2019-12-19T22:08:16.385696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2019-12-19T22:08:21.521691+0000","last_change":"2019-12-19T22:08:06.718253+0000","last_active":"2019-12-19T22:08:21.521691+0000","last_peered":"2019-12-19T22:08:21.521691+0000","last_clean":"2019-12-19T22:08:21.521691+0000","last_became_active":"2019-12-19T22:08:06.717951+0000","last_became_peered":"2019-12-19T22:08:06.717951+0000","last_unstale":"2019-12-19T22:08:21.521691+0000","last_undegraded":"2019-12-19T22:08:21.521691+0000","last_fullsized":"2019-12-19T22:08:21.521691+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_clean_scrub_stamp":"2019-12-19T22:08:06.374096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"18","reported_epoch":"23","state":"active+clean","last_fresh":"2019-12-19T22:08:21.521624+0000","last_change":"2019-12-19T22:08:03.376599+0000","last_active":"2019-12-19T22:08:21.521624+0000","last_peered":"2019-12-19T22:08:21.521624+0000","last_clean":"2019-12-19T22:08:21.521624+0000","last_became_active":"2019-12-19T22:08:03.376233+0000","last_became_peered":"2019-12-19T22:08:03.376233+0000","last_unstale":"2019-12-19T22:08:21.521624+0000","last_undegraded":"2019-12-19T22:08:21.521624+0000","last_fullsized":"2019-12-19T22:08:21.521624+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_clean_scrub_stamp":"2019-12-19T22:08:02.364860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"17'4","reported_seq":"18","reported_epoch":"21","state":"active+clean","last_fresh":"2019-12-19T22:08:19.397791+0000","last_change":"2019-12-19T22:08:06.383420+0000","last_active":"2019-12-19T22:08:19.397791+0000","last_peered":"2019-12-19T22:08:19.397791+0000","last_clean":"2019-12-19T22:08:19.397791+0000","last_became_active":"2019-12-19T22:08:06.382998+0000","last_became_peered":"2019-12-19T22:08:06.382998+0000","last_unstale":"2019-12-19T22:08:19.397791+0000","last_undegraded":"2019-12-19T22:08:19.397791+0000","last_fullsized":"2019-12-19T22:08:19.397791+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_clean_scrub_stamp":"2019-12-19T22:08:05.371035+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"12","reported_epoch":"23","state":"active+clean","last_fresh":"2019-12-19T22:08:21.521484+0000","last_change":"2019-12-19T22:08:17.394609+0000","last_active":"2019-12-19T22:08:21.521484+0000","last_peered":"2019-12-19T22:08:21.521484+0000","last_clean":"2019-12-19T22:08:21.521484+0000","last_became_active":"2019-12-19T22:08:17.394220+0000","last_became_peered":"2019-12-19T22:08:17.394220+0000","last_unstale":"2019-12-19T22:08:21.521484+0000","last_undegraded":"2019-12-19T22:08:21.521484+0000","last_fullsized":"2019-12-19T22:08:21.521484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:16.385696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:16.385696+0000","last_clean_scrub_stamp":"2019-12-19T22:08:16.385696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-19T22:08:21.522400+0000","last_change":"2019-12-19T22:08:06.715884+0000","last_active":"2019-12-19T22:08:21.522400+0000","last_peered":"2019-12-19T22:08:21.522400+0000","last_clean":"2019-12-19T22:08:21.522400+0000","last_became_active":"2019-12-19T22:08:06.715475+0000","last_became_peered":"2019-12-19T22:08:06.715475+0000","last_unstale":"2019-12-19T22:08:21.522400+0000","last_undegraded":"2019-12-19T22:08:21.522400+0000","last_fullsized":"2019-12-19T22:08:21.522400+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_clean_scrub_stamp":"2019-12-19T22:08:06.374096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"17","reported_epoch":"21","state":"active+clean","last_fresh":"2019-12-19T22:08:19.397494+0000","last_change":"2019-12-19T22:08:03.374278+0000","last_active":"2019-12-19T22:08:19.397494+0000","last_peered":"2019-12-19T22:08:19.397494+0000","last_clean":"2019-12-19T22:08:19.397494+0000","last_became_active":"2019-12-19T22:08:03.373911+0000","last_became_peered":"2019-12-19T22:08:03.373911+0000","last_unstale":"2019-12-19T22:08:19.397494+0000","last_undegraded":"2019-12-19T22:08:19.397494+0000","last_fullsized":"2019-12-19T22:08:19.397494+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_clean_scrub_stamp":"2019-12-19T22:08:02.364860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"17'7","reported_seq":"21","reported_epoch":"21","state":"active+clean","last_fresh":"2019-12-19T22:08:19.397740+0000","last_change":"2019-12-19T22:08:06.383498+0000","last_active":"2019-12-19T22:08:19.397740+0000","last_peered":"2019-12-19T22:08:19.397740+0000","last_clean":"2019-12-19T22:08:19.397740+0000","last_became_active":"2019-12-19T22:08:06.382983+0000","last_became_peered":"2019-12-19T22:08:06.382983+0000","last_unstale":"2019-12-19T22:08:19.397740+0000","last_undegraded":"2019-12-19T22:08:19.397740+0000","last_fullsized":"2019-12-19T22:08:19.397740+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_clean_scrub_stamp":"2019-12-19T22:08:05.371035+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"15","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-19T22:08:21.522107+0000","last_change":"2019-12-19T22:08:06.716855+0000","last_active":"2019-12-19T22:08:21.522107+0000","last_peered":"2019-12-19T22:08:21.522107+0000","last_clean":"2019-12-19T22:08:21.522107+0000","last_became_active":"2019-12-19T22:08:06.716480+0000","last_became_peered":"2019-12-19T22:08:06.716480+0000","last_unstale":"2019-12-19T22:08:21.522107+0000","last_undegraded":"2019-12-19T22:08:21.522107+0000","last_fullsized":"2019-12-19T22:08:21.522107+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_clean_scrub_stamp":"2019-12-19T22:08:06.374096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"17","reported_epoch":"21","state":"active+clean","last_fresh":"2019-12-19T22:08:19.396761+0000","last_change":"2019-12-19T22:08:03.373620+0000","last_active":"2019-12-19T22:08:19.396761+0000","last_peered":"2019-12-19T22:08:19.396761+0000","last_clean":"2019-12-19T22:08:19.396761+0000","last_became_active":"2019-12-19T22:08:03.373242+0000","last_became_peered":"2019-12-19T22:08:03.373242+0000","last_unstale":"2019-12-19T22:08:19.396761+0000","last_undegraded":"2019-12-19T22:08:19.396761+0000","last_fullsized":"2019-12-19T22:08:19.396761+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_clean_scrub_stamp":"2019-12-19T22:08:02.364860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'8","reported_seq":"24","reported_epoch":"23","state":"active+clean","last_fresh":"2019-12-19T22:08:21.521520+0000","last_change":"2019-12-19T22:08:06.384597+0000","last_active":"2019-12-19T22:08:21.521520+0000","last_peered":"2019-12-19T22:08:21.521520+0000","last_clean":"2019-12-19T22:08:21.521520+0000","last_became_active":"2019-12-19T22:08:06.383672+0000","last_became_peered":"2019-12-19T22:08:06.383672+0000","last_unstale":"2019-12-19T22:08:21.521520+0000","last_undegraded":"2019-12-19T22:08:21.521520+0000","last_fullsized":"2019-12-19T22:08:21.521520+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_clean_scrub_stamp":"2019-12-19T22:08:05.371035+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"13","reported_epoch":"21","state":"active+clean","last_fresh":"2019-12-19T22:08:19.397330+0000","last_change":"2019-12-19T22:08:06.717297+0000","last_active":"2019-12-19T22:08:19.397330+0000","last_peered":"2019-12-19T22:08:19.397330+0000","last_clean":"2019-12-19T22:08:19.397330+0000","last_became_active":"2019-12-19T22:08:06.717028+0000","last_became_peered":"2019-12-19T22:08:06.717028+0000","last_unstale":"2019-12-19T22:08:19.397330+0000","last_undegraded":"2019-12-19T22:08:19.397330+0000","last_fullsized":"2019-12-19T22:08:19.397330+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_clean_scrub_stamp":"2019-12-19T22:08:06.374096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"19","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-19T22:08:21.522032+0000","last_change":"2019-12-19T22:08:03.375294+0000","last_active":"2019-12-19T22:08:21.522032+0000","last_peered":"2019-12-19T22:08:21.522032+0000","last_clean":"2019-12-19T22:08:21.522032+0000","last_became_active":"2019-12-19T22:08:03.374963+0000","last_became_peered":"2019-12-19T22:08:03.374963+0000","last_unstale":"2019-12-19T22:08:21.522032+0000","last_undegraded":"2019-12-19T22:08:21.522032+0000","last_fullsized":"2019-12-19T22:08:21.522032+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_clean_scrub_stamp":"2019-12-19T22:08:02.364860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"16","reported_epoch":"23","state":"active+clean","last_fresh":"2019-12-19T22:08:21.521672+0000","last_change":"2019-12-19T22:08:06.384407+0000","last_active":"2019-12-19T22:08:21.521672+0000","last_peered":"2019-12-19T22:08:21.521672+0000","last_clean":"2019-12-19T22:08:21.521672+0000","last_became_active":"2019-12-19T22:08:06.383871+0000","last_became_peered":"2019-12-19T22:08:06.383871+0000","last_unstale":"2019-12-19T22:08:21.521672+0000","last_undegraded":"2019-12-19T22:08:21.521672+0000","last_fullsized":"2019-12-19T22:08:21.521672+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_clean_scrub_stamp":"2019-12-19T22:08:05.371035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"13","reported_epoch":"21","state":"active+clean","last_fresh":"2019-12-19T22:08:19.397066+0000","last_change":"2019-12-19T22:08:06.717430+0000","last_active":"2019-12-19T22:08:19.397066+0000","last_peered":"2019-12-19T22:08:19.397066+0000","last_clean":"2019-12-19T22:08:19.397066+0000","last_became_active":"2019-12-19T22:08:06.717085+0000","last_became_peered":"2019-12-19T22:08:06.717085+0000","last_unstale":"2019-12-19T22:08:19.397066+0000","last_undegraded":"2019-12-19T22:08:19.397066+0000","last_fullsized":"2019-12-19T22:08:19.397066+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_clean_scrub_stamp":"2019-12-19T22:08:06.374096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"17","reported_epoch":"21","state":"active+clean","last_fresh":"2019-12-19T22:08:19.397190+0000","last_change":"2019-12-19T22:08:03.375817+0000","last_active":"2019-12-19T22:08:19.397190+0000","last_peered":"2019-12-19T22:08:19.397190+0000","last_clean":"2019-12-19T22:08:19.397190+0000","last_became_active":"2019-12-19T22:08:03.375549+0000","last_became_peered":"2019-12-19T22:08:03.375549+0000","last_unstale":"2019-12-19T22:08:19.397190+0000","last_undegraded":"2019-12-19T22:08:19.397190+0000","last_fullsized":"2019-12-19T22:08:19.397190+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_clean_scrub_stamp":"2019-12-19T22:08:02.364860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'5","reported_seq":"19","reported_epoch":"21","state":"active+clean","last_fresh":"2019-12-19T22:08:19.397336+0000","last_change":"2019-12-19T22:08:06.382991+0000","last_active":"2019-12-19T22:08:19.397336+0000","last_peered":"2019-12-19T22:08:19.397336+0000","last_clean":"2019-12-19T22:08:19.397336+0000","last_became_active":"2019-12-19T22:08:06.382299+0000","last_became_peered":"2019-12-19T22:08:06.382299+0000","last_unstale":"2019-12-19T22:08:19.397336+0000","last_undegraded":"2019-12-19T22:08:19.397336+0000","last_fullsized":"2019-12-19T22:08:19.397336+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_clean_scrub_stamp":"2019-12-19T22:08:05.371035+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-19T22:08:21.522144+0000","last_change":"2019-12-19T22:08:06.716759+0000","last_active":"2019-12-19T22:08:21.522144+0000","last_peered":"2019-12-19T22:08:21.522144+0000","last_clean":"2019-12-19T22:08:21.522144+0000","last_became_active":"2019-12-19T22:08:06.716445+0000","last_became_peered":"2019-12-19T22:08:06.716445+0000","last_unstale":"2019-12-19T22:08:21.522144+0000","last_undegraded":"2019-12-19T22:08:21.522144+0000","last_fullsized":"2019-12-19T22:08:21.522144+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_clean_scrub_stamp":"2019-12-19T22:08:06.374096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"18","reported_epoch":"23","state":"active+clean","last_fresh":"2019-12-19T22:08:21.521603+0000","last_change":"2019-12-19T22:08:03.374496+0000","last_active":"2019-12-19T22:08:21.521603+0000","last_peered":"2019-12-19T22:08:21.521603+0000","last_clean":"2019-12-19T22:08:21.521603+0000","last_became_active":"2019-12-19T22:08:03.373999+0000","last_became_peered":"2019-12-19T22:08:03.373999+0000","last_unstale":"2019-12-19T22:08:21.521603+0000","last_undegraded":"2019-12-19T22:08:21.521603+0000","last_fullsized":"2019-12-19T22:08:21.521603+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_clean_scrub_stamp":"2019-12-19T22:08:02.364860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"17'1","reported_seq":"16","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-19T22:08:21.522076+0000","last_change":"2019-12-19T22:08:06.383835+0000","last_active":"2019-12-19T22:08:21.522076+0000","last_peered":"2019-12-19T22:08:21.522076+0000","last_clean":"2019-12-19T22:08:21.522076+0000","last_became_active":"2019-12-19T22:08:06.383420+0000","last_became_peered":"2019-12-19T22:08:06.383420+0000","last_unstale":"2019-12-19T22:08:21.522076+0000","last_undegraded":"2019-12-19T22:08:21.522076+0000","last_fullsized":"2019-12-19T22:08:21.522076+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_clean_scrub_stamp":"2019-12-19T22:08:05.371035+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"12","reported_epoch":"22","state":"active+clean","last_fresh":"2019-12-19T22:08:21.522041+0000","last_change":"2019-12-19T22:08:17.394797+0000","last_active":"2019-12-19T22:08:21.522041+0000","last_peered":"2019-12-19T22:08:21.522041+0000","last_clean":"2019-12-19T22:08:21.522041+0000","last_became_active":"2019-12-19T22:08:17.394495+0000","last_became_peered":"2019-12-19T22:08:17.394495+0000","last_unstale":"2019-12-19T22:08:21.522041+0000","last_undegraded":"2019-12-19T22:08:21.522041+0000","last_fullsized":"2019-12-19T22:08:21.522041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:16.385696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:16.385696+0000","last_clean_scrub_stamp":"2019-12-19T22:08:16.385696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"13","reported_epoch":"21","state":"active+clean","last_fresh":"2019-12-19T22:08:19.397334+0000","last_change":"2019-12-19T22:08:06.717641+0000","last_active":"2019-12-19T22:08:19.397334+0000","last_peered":"2019-12-19T22:08:19.397334+0000","last_clean":"2019-12-19T22:08:19.397334+0000","last_became_active":"2019-12-19T22:08:06.717289+0000","last_became_peered":"2019-12-19T22:08:06.717289+0000","last_unstale":"2019-12-19T22:08:19.397334+0000","last_undegraded":"2019-12-19T22:08:19.397334+0000","last_fullsized":"2019-12-19T22:08:19.397334+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_clean_scrub_stamp":"2019-12-19T22:08:06.374096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"17","reported_epoch":"21","state":"active+clean","last_fresh":"2019-12-19T22:08:19.397695+0000","last_change":"2019-12-19T22:08:03.375588+0000","last_active":"2019-12-19T22:08:19.397695+0000","last_peered":"2019-12-19T22:08:19.397695+0000","last_clean":"2019-12-19T22:08:19.397695+0000","last_became_active":"2019-12-19T22:08:03.375236+0000","last_became_peered":"2019-12-19T22:08:03.375236+0000","last_unstale":"2019-12-19T22:08:19.397695+0000","last_undegraded":"2019-12-19T22:08:19.397695+0000","last_fullsized":"2019-12-19T22:08:19.397695+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_clean_scrub_stamp":"2019-12-19T22:08:02.364860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"17'6","reported_seq":"20","reported_epoch":"21","state":"active+clean","last_fresh":"2019-12-19T22:08:19.397602+0000","last_change":"2019-12-19T22:08:06.382924+0000","last_active":"2019-12-19T22:08:19.397602+0000","last_peered":"2019-12-19T22:08:19.397602+0000","last_clean":"2019-12-19T22:08:19.397602+0000","last_became_active":"2019-12-19T22:08:06.382181+0000","last_became_peered":"2019-12-19T22:08:06.382181+0000","last_unstale":"2019-12-19T22:08:19.397602+0000","last_undegraded":"2019-12-19T22:08:19.397602+0000","last_fullsized":"2019-12-19T22:08:19.397602+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_clean_scrub_stamp":"2019-12-19T22:08:05.371035+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":"10","reported_epoch":"21","state":"active+clean","last_fresh":"2019-12-19T22:08:19.396896+0000","last_change":"2019-12-19T22:08:17.393884+0000","last_active":"2019-12-19T22:08:19.396896+0000","last_peered":"2019-12-19T22:08:19.396896+0000","last_clean":"2019-12-19T22:08:19.396896+0000","last_became_active":"2019-12-19T22:08:17.393478+0000","last_became_peered":"2019-12-19T22:08:17.393478+0000","last_unstale":"2019-12-19T22:08:19.396896+0000","last_undegraded":"2019-12-19T22:08:19.396896+0000","last_fullsized":"2019-12-19T22:08:19.396896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:16.385696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:16.385696+0000","last_clean_scrub_stamp":"2019-12-19T22:08:16.385696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2019-12-19T22:08:21.521551+0000","last_change":"2019-12-19T22:08:06.718506+0000","last_active":"2019-12-19T22:08:21.521551+0000","last_peered":"2019-12-19T22:08:21.521551+0000","last_clean":"2019-12-19T22:08:21.521551+0000","last_became_active":"2019-12-19T22:08:06.718242+0000","last_became_peered":"2019-12-19T22:08:06.718242+0000","last_unstale":"2019-12-19T22:08:21.521551+0000","last_undegraded":"2019-12-19T22:08:21.521551+0000","last_fullsized":"2019-12-19T22:08:21.521551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_clean_scrub_stamp":"2019-12-19T22:08:06.374096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"17","reported_epoch":"21","state":"active+clean","last_fresh":"2019-12-19T22:08:19.396761+0000","last_change":"2019-12-19T22:08:03.373237+0000","last_active":"2019-12-19T22:08:19.396761+0000","last_peered":"2019-12-19T22:08:19.396761+0000","last_clean":"2019-12-19T22:08:19.396761+0000","last_became_active":"2019-12-19T22:08:03.372918+0000","last_became_peered":"2019-12-19T22:08:03.372918+0000","last_unstale":"2019-12-19T22:08:19.396761+0000","last_undegraded":"2019-12-19T22:08:19.396761+0000","last_fullsized":"2019-12-19T22:08:19.396761+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_clean_scrub_stamp":"2019-12-19T22:08:02.364860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"17'8","reported_seq":"22","reported_epoch":"21","state":"active+clean","last_fresh":"2019-12-19T22:08:19.397560+0000","last_change":"2019-12-19T22:08:06.385018+0000","last_active":"2019-12-19T22:08:19.397560+0000","last_peered":"2019-12-19T22:08:19.397560+0000","last_clean":"2019-12-19T22:08:19.397560+0000","last_became_active":"2019-12-19T22:08:06.384716+0000","last_became_peered":"2019-12-19T22:08:06.384716+0000","last_unstale":"2019-12-19T22:08:19.397560+0000","last_undegraded":"2019-12-19T22:08:19.397560+0000","last_fullsized":"2019-12-19T22:08:19.397560+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_clean_scrub_stamp":"2019-12-19T22:08:05.371035+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1526,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":4,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":8,"acting":8,"num_store_stats":3},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705671,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048808,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808792,"statfs":{"total":107374182400,"available":106300203008,"internally_reserved":1073741824,"allocated":229376,"data_stored":73732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.213}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.297}]}]},{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048780,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808820,"statfs":{"total":107374182400,"available":106300231680,"internally_reserved":1073741824,"allocated":200704,"data_stored":71480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.245}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.194}]}]},{"osd":0,"up_from":9,"seq":38654705672,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048812,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808788,"statfs":{"total":107374182400,"available":106300198912,"internally_reserved":1073741824,"allocated":233472,"data_stored":78029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.363}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.319}]}]}]}} 2019-12-19T22:08:27.587 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-12-19T22:08:27.708 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.703+0000 7fdc7c76e700 1 Processor -- start 2019-12-19T22:08:27.708 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.703+0000 7fdc7c76e700 1 -- start start 2019-12-19T22:08:27.708 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.703+0000 7fdc7c76e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdc74089480 0x7fdc740898b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:27.709 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.703+0000 7fdc7c76e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc7408edb0 con 0x7fdc7408f3d0 2019-12-19T22:08:27.709 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.703+0000 7fdc7c76e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc7408ae60 con 0x7fdc74089480 2019-12-19T22:08:27.709 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.704+0000 7fdc7ad0b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdc74089480 0x7fdc740898b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:27.709 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.704+0000 7fdc7ad0b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdc74089480 0x7fdc740898b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53948/0 (socket says 172.21.15.50:53948) 2019-12-19T22:08:27.709 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.704+0000 7fdc7ad0b700 1 -- 172.21.15.50:0/1317733950 learned_addr learned my addr 172.21.15.50:0/1317733950 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:27.709 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.704+0000 7fdc7a50a700 1 --1- 172.21.15.50:0/1317733950 >> v1:172.21.15.50:6789/0 conn(0x7fdc7408f3d0 0x7fdc74081170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40076/0 (socket says 172.21.15.50:40076) 2019-12-19T22:08:27.709 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.704+0000 7fdc7ad0b700 1 -- 172.21.15.50:0/1317733950 >> v1:172.21.15.50:6789/0 conn(0x7fdc7408f3d0 legacy=0x7fdc74081170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:27.710 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.704+0000 7fdc7ad0b700 1 -- 172.21.15.50:0/1317733950 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc74081970 con 0x7fdc74089480 2019-12-19T22:08:27.710 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.704+0000 7fdc7ad0b700 1 --2- 172.21.15.50:0/1317733950 >> v2:172.21.15.50:3300/0 conn(0x7fdc74089480 0x7fdc740898b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdc70008790 tx=0x7fdc7000fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:27.710 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.704+0000 7fdc7ad0b700 1 --2- 172.21.15.50:0/1317733950 >> v2:172.21.15.50:3300/0 conn(0x7fdc74089480 0x7fdc740898b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdc70008790 tx=0x7fdc7000fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:27.710 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.704+0000 7fdc7ad0b700 1 --2- 172.21.15.50:0/1317733950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc74089480 0x7fdc740898b0 secure :-1 s=READY pgs=255 cs=0 l=1 rx=0x7fdc70008790 tx=0x7fdc7000fcb0).ready entity=mon.0 client_cookie=7cd14c6dae9e2a13 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:27.710 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.704+0000 7fdc7ad0b700 1 --2- 172.21.15.50:0/1317733950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc74089480 0x7fdc740898b0 secure :-1 s=THROTTLE_DONE pgs=255 cs=0 l=1 rx=0x7fdc70008790 tx=0x7fdc7000fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:27.710 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.704+0000 7fdc79d09700 1 -- 172.21.15.50:0/1317733950 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fdc70011330 con 0x7fdc74089480 2019-12-19T22:08:27.710 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.704+0000 7fdc7ad0b700 1 --2- 172.21.15.50:0/1317733950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc74089480 0x7fdc740898b0 secure :-1 s=THROTTLE_DONE pgs=255 cs=0 l=1 rx=0x7fdc70008790 tx=0x7fdc7000fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:27.711 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.704+0000 7fdc7ad0b700 1 --2- 172.21.15.50:0/1317733950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc74089480 0x7fdc740898b0 secure :-1 s=THROTTLE_DONE pgs=255 cs=0 l=1 rx=0x7fdc70008790 tx=0x7fdc7000fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:27.711 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.704+0000 7fdc79d09700 1 -- 172.21.15.50:0/1317733950 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc70011530 con 0x7fdc74089480 2019-12-19T22:08:27.711 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.704+0000 7fdc79d09700 1 -- 172.21.15.50:0/1317733950 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fdc70011850 con 0x7fdc74089480 2019-12-19T22:08:27.711 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.704+0000 7fdc7c76e700 1 -- 172.21.15.50:0/1317733950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc74089480 msgr2=0x7fdc740898b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:27.711 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.704+0000 7fdc7c76e700 1 --2- 172.21.15.50:0/1317733950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc74089480 0x7fdc740898b0 secure :-1 s=READY pgs=255 cs=0 l=1 rx=0x7fdc70008790 tx=0x7fdc7000fcb0).stop 2019-12-19T22:08:27.711 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.705+0000 7fdc7c76e700 1 -- 172.21.15.50:0/1317733950 shutdown_connections 2019-12-19T22:08:27.711 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.705+0000 7fdc7c76e700 1 --2- 172.21.15.50:0/1317733950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc74089480 0x7fdc740898b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:27.712 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.705+0000 7fdc7c76e700 1 -- 172.21.15.50:0/1317733950 shutdown_connections 2019-12-19T22:08:27.712 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.705+0000 7fdc7c76e700 1 -- 172.21.15.50:0/1317733950 wait complete. 2019-12-19T22:08:27.712 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.705+0000 7fdc7c76e700 1 -- 172.21.15.50:0/1317733950 >> 172.21.15.50:0/1317733950 conn(0x7fdc74067e70 msgr2=0x7fdc74094570 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:27.712 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.706+0000 7fdc7c76e700 1 Processor -- start 2019-12-19T22:08:27.712 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.706+0000 7fdc7c76e700 1 -- start start 2019-12-19T22:08:27.715 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.706+0000 7fdc7c76e700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdc7411f6d0 0x7fdc7411fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:27.715 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.706+0000 7fdc7c76e700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc74120480 con 0x7fdc74120050 2019-12-19T22:08:27.716 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.706+0000 7fdc7c76e700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc740912f0 con 0x7fdc7411f6d0 2019-12-19T22:08:27.716 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.706+0000 7fdc7ad0b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdc7411f6d0 0x7fdc7411fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:27.716 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.706+0000 7fdc7a50a700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fdc74120050 0x7fdc74061820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40082/0 (socket says 172.21.15.50:40082) 2019-12-19T22:08:27.716 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.706+0000 7fdc7ad0b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fdc7411f6d0 0x7fdc7411fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53952/0 (socket says 172.21.15.50:53952) 2019-12-19T22:08:27.716 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.706+0000 7fdc7a50a700 1 -- 172.21.15.50:0/2842091267 learned_addr learned my addr 172.21.15.50:0/2842091267 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:27.716 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.706+0000 7fdc7ad0b700 1 -- 172.21.15.50:0/2842091267 >> v1:172.21.15.50:6789/0 conn(0x7fdc74120050 legacy=0x7fdc74061820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:27.716 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.706+0000 7fdc7ad0b700 1 -- 172.21.15.50:0/2842091267 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc74064690 con 0x7fdc7411f6d0 2019-12-19T22:08:27.717 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.706+0000 7fdc6b7fe700 1 -- 172.21.15.50:0/2842091267 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1638127827 0 0) 0x7fdc74120480 con 0x7fdc74120050 2019-12-19T22:08:27.717 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.707+0000 7fdc7ad0b700 1 --2- 172.21.15.50:0/2842091267 >> v2:172.21.15.50:3300/0 conn(0x7fdc7411f6d0 0x7fdc7411fb00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdc70008790 tx=0x7fdc7000f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:27.717 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.707+0000 7fdc7ad0b700 1 --2- 172.21.15.50:0/2842091267 >> v2:172.21.15.50:3300/0 conn(0x7fdc7411f6d0 0x7fdc7411fb00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdc70008790 tx=0x7fdc7000f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:27.717 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.707+0000 7fdc7ad0b700 1 --2- 172.21.15.50:0/2842091267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc7411f6d0 0x7fdc7411fb00 secure :-1 s=READY pgs=257 cs=0 l=1 rx=0x7fdc70008790 tx=0x7fdc7000f780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:27.717 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.707+0000 7fdc7ad0b700 1 --2- 172.21.15.50:0/2842091267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc7411f6d0 0x7fdc7411fb00 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7fdc70008790 tx=0x7fdc7000f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:27.717 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.707+0000 7fdc6b7fe700 1 -- 172.21.15.50:0/2842091267 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fdc70007280 con 0x7fdc7411f6d0 2019-12-19T22:08:27.717 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.707+0000 7fdc7ad0b700 1 --2- 172.21.15.50:0/2842091267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc7411f6d0 0x7fdc7411fb00 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7fdc70008790 tx=0x7fdc7000f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:27.718 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.707+0000 7fdc7ad0b700 1 --2- 172.21.15.50:0/2842091267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc7411f6d0 0x7fdc7411fb00 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7fdc70008790 tx=0x7fdc7000f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:27.718 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.707+0000 7fdc6b7fe700 1 -- 172.21.15.50:0/2842091267 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc70007480 con 0x7fdc7411f6d0 2019-12-19T22:08:27.718 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.707+0000 7fdc7c76e700 1 -- 172.21.15.50:0/2842091267 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc74062c30 con 0x7fdc7411f6d0 2019-12-19T22:08:27.718 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.707+0000 7fdc6b7fe700 1 -- 172.21.15.50:0/2842091267 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fdc700116f0 con 0x7fdc7411f6d0 2019-12-19T22:08:27.718 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.707+0000 7fdc7c76e700 1 -- 172.21.15.50:0/2842091267 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc74062f80 con 0x7fdc7411f6d0 2019-12-19T22:08:27.718 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.707+0000 7fdc7ad0b700 1 --2- 172.21.15.50:0/2842091267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc7411f6d0 0x7fdc7411fb00 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7fdc70008790 tx=0x7fdc7000f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:27.718 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.707+0000 7fdc6b7fe700 1 -- 172.21.15.50:0/2842091267 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7fdc70005540 con 0x7fdc7411f6d0 2019-12-19T22:08:27.719 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.707+0000 7fdc7ad0b700 1 --2- 172.21.15.50:0/2842091267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc7411f6d0 0x7fdc7411fb00 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7fdc70008790 tx=0x7fdc7000f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:27.719 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.707+0000 7fdc6b7fe700 1 --2- 172.21.15.50:0/2842091267 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fdc5c01f9f0 0x7fdc5c021f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:27.719 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.707+0000 7fdc6b7fe700 1 -- 172.21.15.50:0/2842091267 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3786+0+0 (secure 0 0 0) 0x7fdc7002aa70 con 0x7fdc7411f6d0 2019-12-19T22:08:27.719 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.707+0000 7fdc7a50a700 1 --2- 172.21.15.50:0/2842091267 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fdc5c01f9f0 0x7fdc5c021f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:27.719 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.708+0000 7fdc7a50a700 1 --2- 172.21.15.50:0/2842091267 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fdc5c01f9f0 0x7fdc5c021f00 crc :-1 s=READY pgs=62 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:27.719 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.708+0000 7fdc7c76e700 1 -- 172.21.15.50:0/2842091267 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc74056340 con 0x7fdc7411f6d0 2019-12-19T22:08:27.719 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.711+0000 7fdc7ad0b700 1 --2- 172.21.15.50:0/2842091267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc7411f6d0 0x7fdc7411fb00 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7fdc70008790 tx=0x7fdc7000f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:27.720 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.711+0000 7fdc6b7fe700 1 -- 172.21.15.50:0/2842091267 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7fdc70005d70 con 0x7fdc7411f6d0 2019-12-19T22:08:27.853 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.851+0000 7fdc7c76e700 1 -- 172.21.15.50:0/2842091267 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc7408dcf0 con 0x7fdc7411f6d0 2019-12-19T22:08:27.854 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.851+0000 7fdc7ad0b700 1 --2- 172.21.15.50:0/2842091267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc7411f6d0 0x7fdc7411fb00 secure :-1 s=THROTTLE_DONE pgs=257 cs=0 l=1 rx=0x7fdc70008790 tx=0x7fdc7000f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:27.854 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.851+0000 7fdc6b7fe700 1 -- 172.21.15.50:0/2842091267 <== mon.0 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+10340 (secure 0 0 0) 0x7fdc70005850 con 0x7fdc7411f6d0 2019-12-19T22:08:27.854 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:08:27.855 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":25,"fsid":"c1382993-41cc-4b35-a402-c17778701f01","created":"2019-12-19T22:07:52.345475+0000","modified":"2019-12-19T22:08:23.402450+0000","last_up_change":"2019-12-19T22:07:58.357117+0000","last_in_change":"2019-12-19T22:07:58.357117+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-19T22:08:01.570202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2019-12-19T22:08:04.515784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2019-12-19T22:08:05.689151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"21","last_force_op_resend_prenautilus":"21","last_force_op_resend_preluminous":"21","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[4],"tier_of":-1,"read_tier":4,"write_tier":4,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"data_cache","create_time":"2019-12-19T22:08:16.355664+0000","flags":9,"flags_names":"hashpspool,incomplete_clones","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":4,"pg_placement_num":4,"pg_placement_num_target":4,"pg_num_target":4,"pg_num_pending":4,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"21","last_force_op_resend_prenautilus":"21","last_force_op_resend_preluminous":"21","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":3,"read_tier":-1,"write_tier":-1,"cache_mode":"writeback","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"bloom","false_positive_probability":0.050000000000000003,"target_size":0,"seed":0},"hit_set_period":3600,"hit_set_count":8,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{}}],"osds":[{"osd":0,"uuid":"6137ed8c-8e2c-4e88-8634-dc763bed14c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6815","nonce":27757},{"type":"v1","addr":"172.21.15.50:6817","nonce":27757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":27757},{"type":"v1","addr":"172.21.15.50:6819","nonce":27757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":27757},{"type":"v1","addr":"172.21.15.50:6823","nonce":27757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":27757},{"type":"v1","addr":"172.21.15.50:6821","nonce":27757}]},"public_addr":"172.21.15.50:6817/27757","cluster_addr":"172.21.15.50:6819/27757","heartbeat_back_addr":"172.21.15.50:6823/27757","heartbeat_front_addr":"172.21.15.50:6821/27757","state":["exists","up"]},{"osd":1,"uuid":"57d4e31d-408e-4302-859d-7ea672b93772","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":27758},{"type":"v1","addr":"172.21.15.50:6801","nonce":27758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":27758},{"type":"v1","addr":"172.21.15.50:6803","nonce":27758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6809","nonce":27758},{"type":"v1","addr":"172.21.15.50:6810","nonce":27758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6805","nonce":27758},{"type":"v1","addr":"172.21.15.50:6807","nonce":27758}]},"public_addr":"172.21.15.50:6801/27758","cluster_addr":"172.21.15.50:6803/27758","heartbeat_back_addr":"172.21.15.50:6810/27758","heartbeat_front_addr":"172.21.15.50:6807/27758","state":["exists","up"]},{"osd":2,"uuid":"600ea585-aa50-4596-9b14-090eab15f9a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":27759},{"type":"v1","addr":"172.21.15.50:6806","nonce":27759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":27759},{"type":"v1","addr":"172.21.15.50:6811","nonce":27759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":27759},{"type":"v1","addr":"172.21.15.50:6816","nonce":27759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":27759},{"type":"v1","addr":"172.21.15.50:6813","nonce":27759}]},"public_addr":"172.21.15.50:6806/27759","cluster_addr":"172.21.15.50:6811/27759","heartbeat_back_addr":"172.21.15.50:6816/27759","heartbeat_front_addr":"172.21.15.50:6813/27759","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-19T22:07:56.415731+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-19T22:07:56.346062+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-19T22:07:56.090889+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-19T22:08:27.856 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.853+0000 7fdc7c76e700 1 -- 172.21.15.50:0/2842091267 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fdc5c01f9f0 msgr2=0x7fdc5c021f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:27.856 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.853+0000 7fdc7c76e700 1 --2- 172.21.15.50:0/2842091267 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fdc5c01f9f0 0x7fdc5c021f00 crc :-1 s=READY pgs=62 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:27.856 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.853+0000 7fdc7c76e700 1 -- 172.21.15.50:0/2842091267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc7411f6d0 msgr2=0x7fdc7411fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:27.856 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.853+0000 7fdc7c76e700 1 --2- 172.21.15.50:0/2842091267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc7411f6d0 0x7fdc7411fb00 secure :-1 s=READY pgs=257 cs=0 l=1 rx=0x7fdc70008790 tx=0x7fdc7000f780).stop 2019-12-19T22:08:27.856 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.853+0000 7fdc7c76e700 1 -- 172.21.15.50:0/2842091267 shutdown_connections 2019-12-19T22:08:27.856 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.853+0000 7fdc7c76e700 1 --2- 172.21.15.50:0/2842091267 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fdc5c01f9f0 0x7fdc5c021f00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:27.857 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.853+0000 7fdc7c76e700 1 --2- 172.21.15.50:0/2842091267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdc7411f6d0 0x7fdc7411fb00 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:27.857 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.853+0000 7fdc7c76e700 1 -- 172.21.15.50:0/2842091267 shutdown_connections 2019-12-19T22:08:27.857 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.853+0000 7fdc7c76e700 1 -- 172.21.15.50:0/2842091267 wait complete. 2019-12-19T22:08:27.857 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:27.853+0000 7fdc7c76e700 1 -- 172.21.15.50:0/2842091267 >> 172.21.15.50:0/2842091267 conn(0x7fdc74081c40 msgr2=0x7fdc7408bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:28.866 INFO:tasks.ceph:Scrubbing osd.0 2019-12-19T22:08:28.867 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2019-12-19T22:08:28.999 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.994+0000 7f37eb568700 1 Processor -- start 2019-12-19T22:08:28.999 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.994+0000 7f37eb568700 1 -- start start 2019-12-19T22:08:29.000 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.995+0000 7f37eb568700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f37e4089940 0x7f37e4081880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:29.000 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.995+0000 7f37eb568700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37e408bd70 con 0x7f37e4089510 2019-12-19T22:08:29.000 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.995+0000 7f37eb568700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37e4065360 con 0x7f37e4089940 2019-12-19T22:08:29.000 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.995+0000 7f37e9304700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f37e4089940 0x7f37e4081880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:29.000 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.995+0000 7f37e9304700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f37e4089940 0x7f37e4081880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53958/0 (socket says 172.21.15.50:53958) 2019-12-19T22:08:29.000 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.995+0000 7f37e9304700 1 -- 172.21.15.50:0/1704397409 learned_addr learned my addr 172.21.15.50:0/1704397409 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:29.000 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.995+0000 7f37e9b05700 1 --1- 172.21.15.50:0/1704397409 >> v1:172.21.15.50:6789/0 conn(0x7f37e4089510 0x7f37e4081080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40086/0 (socket says 172.21.15.50:40086) 2019-12-19T22:08:29.001 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.995+0000 7f37e9304700 1 -- 172.21.15.50:0/1704397409 >> v1:172.21.15.50:6789/0 conn(0x7f37e4089510 legacy=0x7f37e4081080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:29.001 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.995+0000 7f37e9304700 1 -- 172.21.15.50:0/1704397409 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e40663a0 con 0x7f37e4089940 2019-12-19T22:08:29.001 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.995+0000 7f37e9304700 1 --2- 172.21.15.50:0/1704397409 >> v2:172.21.15.50:3300/0 conn(0x7f37e4089940 0x7f37e4081880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f37d4008790 tx=0x7f37d400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.001 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.995+0000 7f37e9304700 1 --2- 172.21.15.50:0/1704397409 >> v2:172.21.15.50:3300/0 conn(0x7f37e4089940 0x7f37e4081880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f37d4008790 tx=0x7f37d400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.001 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.995+0000 7f37e9304700 1 --2- 172.21.15.50:0/1704397409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37e4089940 0x7f37e4081880 secure :-1 s=READY pgs=259 cs=0 l=1 rx=0x7f37d4008790 tx=0x7f37d400fcb0).ready entity=mon.0 client_cookie=864f6087715992fb server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:29.001 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.995+0000 7f37e9304700 1 --2- 172.21.15.50:0/1704397409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37e4089940 0x7f37e4081880 secure :-1 s=THROTTLE_DONE pgs=259 cs=0 l=1 rx=0x7f37d4008790 tx=0x7f37d400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.001 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.995+0000 7f37e8b03700 1 -- 172.21.15.50:0/1704397409 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f37d4011330 con 0x7f37e4089940 2019-12-19T22:08:29.002 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.995+0000 7f37e9304700 1 --2- 172.21.15.50:0/1704397409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37e4089940 0x7f37e4081880 secure :-1 s=THROTTLE_DONE pgs=259 cs=0 l=1 rx=0x7f37d4008790 tx=0x7f37d400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.002 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.995+0000 7f37e9304700 1 --2- 172.21.15.50:0/1704397409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37e4089940 0x7f37e4081880 secure :-1 s=THROTTLE_DONE pgs=259 cs=0 l=1 rx=0x7f37d4008790 tx=0x7f37d400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.002 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.995+0000 7f37e8b03700 1 -- 172.21.15.50:0/1704397409 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d4011530 con 0x7f37e4089940 2019-12-19T22:08:29.002 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.995+0000 7f37e8b03700 1 -- 172.21.15.50:0/1704397409 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f37d4011850 con 0x7f37e4089940 2019-12-19T22:08:29.002 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.995+0000 7f37eb568700 1 -- 172.21.15.50:0/1704397409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37e4089940 msgr2=0x7f37e4081880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:29.003 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.995+0000 7f37eb568700 1 --2- 172.21.15.50:0/1704397409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37e4089940 0x7f37e4081880 secure :-1 s=READY pgs=259 cs=0 l=1 rx=0x7f37d4008790 tx=0x7f37d400fcb0).stop 2019-12-19T22:08:29.003 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.996+0000 7f37eb568700 1 -- 172.21.15.50:0/1704397409 shutdown_connections 2019-12-19T22:08:29.003 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.996+0000 7f37eb568700 1 --2- 172.21.15.50:0/1704397409 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37e4089940 0x7f37e4081880 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:29.003 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.996+0000 7f37eb568700 1 -- 172.21.15.50:0/1704397409 shutdown_connections 2019-12-19T22:08:29.003 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.996+0000 7f37eb568700 1 -- 172.21.15.50:0/1704397409 wait complete. 2019-12-19T22:08:29.004 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.996+0000 7f37eb568700 1 -- 172.21.15.50:0/1704397409 >> 172.21.15.50:0/1704397409 conn(0x7f37e405f610 msgr2=0x7f37e4061a50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:29.004 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.997+0000 7f37eb568700 1 Processor -- start 2019-12-19T22:08:29.004 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.997+0000 7f37eb568700 1 -- start start 2019-12-19T22:08:29.008 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.997+0000 7f37eb568700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f37e4082290 0x7f37e40826c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:29.008 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.997+0000 7f37eb568700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37e4083c90 con 0x7f37e4082c10 2019-12-19T22:08:29.008 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.997+0000 7f37eb568700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37e405ef90 con 0x7f37e4082290 2019-12-19T22:08:29.008 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.997+0000 7f37e9b05700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f37e4082290 0x7f37e40826c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:29.008 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.997+0000 7f37e9304700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f37e4082c10 0x7f37e4077040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40090/0 (socket says 172.21.15.50:40090) 2019-12-19T22:08:29.008 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.997+0000 7f37e9304700 1 -- 172.21.15.50:0/1235612540 learned_addr learned my addr 172.21.15.50:0/1235612540 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:29.009 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.998+0000 7f37e9b05700 1 -- 172.21.15.50:0/1235612540 >> v1:172.21.15.50:6789/0 conn(0x7f37e4082c10 legacy=0x7f37e4077040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:29.009 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.998+0000 7f37e9b05700 1 -- 172.21.15.50:0/1235612540 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e4083040 con 0x7f37e4082290 2019-12-19T22:08:29.009 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.998+0000 7f37da7fc700 1 -- 172.21.15.50:0/1235612540 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3232164503 0 0) 0x7f37e4083c90 con 0x7f37e4082c10 2019-12-19T22:08:29.009 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.998+0000 7f37e9b05700 1 --2- 172.21.15.50:0/1235612540 >> v2:172.21.15.50:3300/0 conn(0x7f37e4082290 0x7f37e40826c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f37e00013e0 tx=0x7f37e000c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.009 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.998+0000 7f37e9b05700 1 --2- 172.21.15.50:0/1235612540 >> v2:172.21.15.50:3300/0 conn(0x7f37e4082290 0x7f37e40826c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f37e00013e0 tx=0x7f37e000c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.009 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.998+0000 7f37e9b05700 1 --2- 172.21.15.50:0/1235612540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37e4082290 0x7f37e40826c0 secure :-1 s=READY pgs=261 cs=0 l=1 rx=0x7f37e00013e0 tx=0x7f37e000c340).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:29.009 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.998+0000 7f37e9b05700 1 --2- 172.21.15.50:0/1235612540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37e4082290 0x7f37e40826c0 secure :-1 s=THROTTLE_DONE pgs=261 cs=0 l=1 rx=0x7f37e00013e0 tx=0x7f37e000c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.010 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.998+0000 7f37da7fc700 1 -- 172.21.15.50:0/1235612540 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f37e00114e0 con 0x7f37e4082290 2019-12-19T22:08:29.010 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.998+0000 7f37e9b05700 1 --2- 172.21.15.50:0/1235612540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37e4082290 0x7f37e40826c0 secure :-1 s=THROTTLE_DONE pgs=261 cs=0 l=1 rx=0x7f37e00013e0 tx=0x7f37e000c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.010 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.998+0000 7f37e9b05700 1 --2- 172.21.15.50:0/1235612540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37e4082290 0x7f37e40826c0 secure :-1 s=THROTTLE_DONE pgs=261 cs=0 l=1 rx=0x7f37e00013e0 tx=0x7f37e000c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.010 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.998+0000 7f37da7fc700 1 -- 172.21.15.50:0/1235612540 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e00116e0 con 0x7f37e4082290 2019-12-19T22:08:29.010 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.998+0000 7f37da7fc700 1 -- 172.21.15.50:0/1235612540 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f37e0011ac0 con 0x7f37e4082290 2019-12-19T22:08:29.010 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.998+0000 7f37eb568700 1 -- 172.21.15.50:0/1235612540 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37e4089370 con 0x7f37e4082290 2019-12-19T22:08:29.010 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.998+0000 7f37eb568700 1 -- 172.21.15.50:0/1235612540 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37e40853e0 con 0x7f37e4082290 2019-12-19T22:08:29.011 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.998+0000 7f37e9b05700 1 --2- 172.21.15.50:0/1235612540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37e4082290 0x7f37e40826c0 secure :-1 s=THROTTLE_DONE pgs=261 cs=0 l=1 rx=0x7f37e00013e0 tx=0x7f37e000c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.011 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.999+0000 7f37da7fc700 1 -- 172.21.15.50:0/1235612540 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7f37e0006460 con 0x7f37e4082290 2019-12-19T22:08:29.011 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.999+0000 7f37e9b05700 1 --2- 172.21.15.50:0/1235612540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37e4082290 0x7f37e40826c0 secure :-1 s=THROTTLE_DONE pgs=261 cs=0 l=1 rx=0x7f37e00013e0 tx=0x7f37e000c340).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.011 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.999+0000 7f37da7fc700 1 --2- 172.21.15.50:0/1235612540 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f37cc01f990 0x7f37cc021ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:29.011 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.999+0000 7f37da7fc700 1 -- 172.21.15.50:0/1235612540 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3786+0+0 (secure 0 0 0) 0x7f37e002a180 con 0x7f37e4082290 2019-12-19T22:08:29.011 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.999+0000 7f37e9304700 1 --2- 172.21.15.50:0/1235612540 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f37cc01f990 0x7f37cc021ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:29.011 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.999+0000 7f37eb568700 1 --2- 172.21.15.50:0/1235612540 >> [v2:172.21.15.50:6815/27757,v1:172.21.15.50:6817/27757] conn(0x7f37e40550c0 0x7f37e40554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:29.012 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.999+0000 7f37eb568700 1 -- 172.21.15.50:0/1235612540 --> [v2:172.21.15.50:6815/27757,v1:172.21.15.50:6817/27757] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f37e4056340 con 0x7f37e40550c0 2019-12-19T22:08:29.012 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.999+0000 7f37ea306700 1 --2- 172.21.15.50:0/1235612540 >> [v2:172.21.15.50:6815/27757,v1:172.21.15.50:6817/27757] conn(0x7f37e40550c0 0x7f37e40554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:29.012 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.999+0000 7f37e9304700 1 --2- 172.21.15.50:0/1235612540 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f37cc01f990 0x7f37cc021ea0 crc :-1 s=READY pgs=63 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:29.012 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:28.999+0000 7f37ea306700 1 --2- 172.21.15.50:0/1235612540 >> [v2:172.21.15.50:6815/27757,v1:172.21.15.50:6817/27757] conn(0x7f37e40550c0 0x7f37e40554f0 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:29.012 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.000+0000 7f37da7fc700 1 -- 172.21.15.50:0/1235612540 <== osd.0 v2:172.21.15.50:6815/27757 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23187 (crc 0 0 0) 0x7f37e4056340 con 0x7f37e40550c0 2019-12-19T22:08:29.021 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.017+0000 7f37eb568700 1 -- 172.21.15.50:0/1235612540 --> [v2:172.21.15.50:6815/27757,v1:172.21.15.50:6817/27757] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f37e4084650 con 0x7f37e40550c0 2019-12-19T22:08:29.021 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.018+0000 7f37da7fc700 1 -- 172.21.15.50:0/1235612540 <== osd.0 v2:172.21.15.50:6815/27757 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f37e4084650 con 0x7f37e40550c0 2019-12-19T22:08:29.021 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.018+0000 7f37eb568700 1 -- 172.21.15.50:0/1235612540 >> [v2:172.21.15.50:6815/27757,v1:172.21.15.50:6817/27757] conn(0x7f37e40550c0 msgr2=0x7f37e40554f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:29.021 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.018+0000 7f37eb568700 1 --2- 172.21.15.50:0/1235612540 >> [v2:172.21.15.50:6815/27757,v1:172.21.15.50:6817/27757] conn(0x7f37e40550c0 0x7f37e40554f0 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:29.022 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.018+0000 7f37eb568700 1 -- 172.21.15.50:0/1235612540 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f37cc01f990 msgr2=0x7f37cc021ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:29.022 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.018+0000 7f37eb568700 1 --2- 172.21.15.50:0/1235612540 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f37cc01f990 0x7f37cc021ea0 crc :-1 s=READY pgs=63 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:29.022 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.018+0000 7f37eb568700 1 -- 172.21.15.50:0/1235612540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37e4082290 msgr2=0x7f37e40826c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:29.022 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.018+0000 7f37eb568700 1 --2- 172.21.15.50:0/1235612540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37e4082290 0x7f37e40826c0 secure :-1 s=READY pgs=261 cs=0 l=1 rx=0x7f37e00013e0 tx=0x7f37e000c340).stop 2019-12-19T22:08:29.022 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.018+0000 7f37eb568700 1 -- 172.21.15.50:0/1235612540 shutdown_connections 2019-12-19T22:08:29.022 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.018+0000 7f37eb568700 1 --2- 172.21.15.50:0/1235612540 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f37cc01f990 0x7f37cc021ea0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:29.022 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.018+0000 7f37eb568700 1 --2- 172.21.15.50:0/1235612540 >> [v2:172.21.15.50:6815/27757,v1:172.21.15.50:6817/27757] conn(0x7f37e40550c0 0x7f37e40554f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:29.023 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.018+0000 7f37eb568700 1 --2- 172.21.15.50:0/1235612540 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37e4082290 0x7f37e40826c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:29.023 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.018+0000 7f37eb568700 1 -- 172.21.15.50:0/1235612540 shutdown_connections 2019-12-19T22:08:29.023 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.018+0000 7f37eb568700 1 -- 172.21.15.50:0/1235612540 wait complete. 2019-12-19T22:08:29.023 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.018+0000 7f37eb568700 1 -- 172.21.15.50:0/1235612540 >> 172.21.15.50:0/1235612540 conn(0x7f37e407c200 msgr2=0x7f37e407dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:29.023 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2019-12-19T22:08:29.024 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2019-12-19T22:08:29.024 INFO:teuthology.orchestra.run.smithi050.stdout:} 2019-12-19T22:08:29.033 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2019-12-19T22:08:29.150 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.145+0000 7fc6685cb700 1 Processor -- start 2019-12-19T22:08:29.150 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.145+0000 7fc6685cb700 1 -- start start 2019-12-19T22:08:29.151 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.146+0000 7fc6685cb700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc6600898b0 0x7fc660081170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:29.151 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.146+0000 7fc6685cb700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc660089ce0 con 0x7fc660089480 2019-12-19T22:08:29.151 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.146+0000 7fc6685cb700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc66008ae60 con 0x7fc6600898b0 2019-12-19T22:08:29.151 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.146+0000 7fc666367700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc6600898b0 0x7fc660081170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:29.151 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.146+0000 7fc666367700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc6600898b0 0x7fc660081170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53968/0 (socket says 172.21.15.50:53968) 2019-12-19T22:08:29.151 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.146+0000 7fc666367700 1 -- 172.21.15.50:0/2369011384 learned_addr learned my addr 172.21.15.50:0/2369011384 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:29.151 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.146+0000 7fc666b68700 1 --1- 172.21.15.50:0/2369011384 >> v1:172.21.15.50:6789/0 conn(0x7fc660089480 0x7fc66008f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40096/0 (socket says 172.21.15.50:40096) 2019-12-19T22:08:29.152 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.146+0000 7fc666367700 1 -- 172.21.15.50:0/2369011384 >> v1:172.21.15.50:6789/0 conn(0x7fc660089480 legacy=0x7fc66008f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:29.152 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.146+0000 7fc666367700 1 -- 172.21.15.50:0/2369011384 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc66008edb0 con 0x7fc6600898b0 2019-12-19T22:08:29.152 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.146+0000 7fc666367700 1 --2- 172.21.15.50:0/2369011384 >> v2:172.21.15.50:3300/0 conn(0x7fc6600898b0 0x7fc660081170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc654008790 tx=0x7fc65400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.152 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.146+0000 7fc666367700 1 --2- 172.21.15.50:0/2369011384 >> v2:172.21.15.50:3300/0 conn(0x7fc6600898b0 0x7fc660081170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc654008790 tx=0x7fc65400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.152 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.146+0000 7fc666367700 1 --2- 172.21.15.50:0/2369011384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6600898b0 0x7fc660081170 secure :-1 s=READY pgs=263 cs=0 l=1 rx=0x7fc654008790 tx=0x7fc65400fcb0).ready entity=mon.0 client_cookie=ff5178307e126e3 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:29.152 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.146+0000 7fc666367700 1 --2- 172.21.15.50:0/2369011384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6600898b0 0x7fc660081170 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7fc654008790 tx=0x7fc65400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.153 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.146+0000 7fc665b66700 1 -- 172.21.15.50:0/2369011384 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fc654011330 con 0x7fc6600898b0 2019-12-19T22:08:29.153 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.146+0000 7fc666367700 1 --2- 172.21.15.50:0/2369011384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6600898b0 0x7fc660081170 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7fc654008790 tx=0x7fc65400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.153 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.146+0000 7fc666367700 1 --2- 172.21.15.50:0/2369011384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6600898b0 0x7fc660081170 secure :-1 s=THROTTLE_DONE pgs=263 cs=0 l=1 rx=0x7fc654008790 tx=0x7fc65400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.153 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.146+0000 7fc665b66700 1 -- 172.21.15.50:0/2369011384 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc654011530 con 0x7fc6600898b0 2019-12-19T22:08:29.153 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.146+0000 7fc665b66700 1 -- 172.21.15.50:0/2369011384 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fc654011850 con 0x7fc6600898b0 2019-12-19T22:08:29.153 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.146+0000 7fc6685cb700 1 -- 172.21.15.50:0/2369011384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6600898b0 msgr2=0x7fc660081170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:29.153 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.146+0000 7fc6685cb700 1 --2- 172.21.15.50:0/2369011384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6600898b0 0x7fc660081170 secure :-1 s=READY pgs=263 cs=0 l=1 rx=0x7fc654008790 tx=0x7fc65400fcb0).stop 2019-12-19T22:08:29.154 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.147+0000 7fc6685cb700 1 -- 172.21.15.50:0/2369011384 shutdown_connections 2019-12-19T22:08:29.154 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.147+0000 7fc6685cb700 1 --2- 172.21.15.50:0/2369011384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc6600898b0 0x7fc660081170 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:29.154 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.147+0000 7fc6685cb700 1 -- 172.21.15.50:0/2369011384 shutdown_connections 2019-12-19T22:08:29.154 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.147+0000 7fc6685cb700 1 -- 172.21.15.50:0/2369011384 wait complete. 2019-12-19T22:08:29.154 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.147+0000 7fc6685cb700 1 -- 172.21.15.50:0/2369011384 >> 172.21.15.50:0/2369011384 conn(0x7fc660067e70 msgr2=0x7fc660094570 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:29.154 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.148+0000 7fc6685cb700 1 Processor -- start 2019-12-19T22:08:29.154 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.148+0000 7fc6685cb700 1 -- start start 2019-12-19T22:08:29.157 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.148+0000 7fc6685cb700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc660090040 0x7fc660090470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:29.157 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.148+0000 7fc6685cb700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc660090df0 con 0x7fc6600909c0 2019-12-19T22:08:29.157 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.148+0000 7fc6685cb700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6600841a0 con 0x7fc660090040 2019-12-19T22:08:29.158 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.148+0000 7fc666b68700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fc660090040 0x7fc660090470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:29.158 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.148+0000 7fc666367700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fc6600909c0 0x7fc660079fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40102/0 (socket says 172.21.15.50:40102) 2019-12-19T22:08:29.158 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.148+0000 7fc666367700 1 -- 172.21.15.50:0/1769968086 learned_addr learned my addr 172.21.15.50:0/1769968086 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:29.158 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.149+0000 7fc666b68700 1 -- 172.21.15.50:0/1769968086 >> v1:172.21.15.50:6789/0 conn(0x7fc6600909c0 legacy=0x7fc660079fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:29.158 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.149+0000 7fc666b68700 1 -- 172.21.15.50:0/1769968086 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc660082200 con 0x7fc660090040 2019-12-19T22:08:29.158 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.149+0000 7fc6537fe700 1 -- 172.21.15.50:0/1769968086 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3055044475 0 0) 0x7fc660090df0 con 0x7fc6600909c0 2019-12-19T22:08:29.158 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.149+0000 7fc666b68700 1 --2- 172.21.15.50:0/1769968086 >> v2:172.21.15.50:3300/0 conn(0x7fc660090040 0x7fc660090470 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc65c000b80 tx=0x7fc65c0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.159 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.149+0000 7fc666b68700 1 --2- 172.21.15.50:0/1769968086 >> v2:172.21.15.50:3300/0 conn(0x7fc660090040 0x7fc660090470 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc65c000b80 tx=0x7fc65c0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.159 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.149+0000 7fc666b68700 1 --2- 172.21.15.50:0/1769968086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc660090040 0x7fc660090470 secure :-1 s=READY pgs=265 cs=0 l=1 rx=0x7fc65c000b80 tx=0x7fc65c0107b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:29.159 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.149+0000 7fc666b68700 1 --2- 172.21.15.50:0/1769968086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc660090040 0x7fc660090470 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7fc65c000b80 tx=0x7fc65c0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.159 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.149+0000 7fc6537fe700 1 -- 172.21.15.50:0/1769968086 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fc65c0066d0 con 0x7fc660090040 2019-12-19T22:08:29.159 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.149+0000 7fc666b68700 1 --2- 172.21.15.50:0/1769968086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc660090040 0x7fc660090470 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7fc65c000b80 tx=0x7fc65c0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.159 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.149+0000 7fc666b68700 1 --2- 172.21.15.50:0/1769968086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc660090040 0x7fc660090470 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7fc65c000b80 tx=0x7fc65c0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.159 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.149+0000 7fc6537fe700 1 -- 172.21.15.50:0/1769968086 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc65c0068d0 con 0x7fc660090040 2019-12-19T22:08:29.160 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.149+0000 7fc6685cb700 1 -- 172.21.15.50:0/1769968086 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc66007b080 con 0x7fc660090040 2019-12-19T22:08:29.160 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.149+0000 7fc6537fe700 1 -- 172.21.15.50:0/1769968086 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fc65c006cb0 con 0x7fc660090040 2019-12-19T22:08:29.160 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.149+0000 7fc6685cb700 1 -- 172.21.15.50:0/1769968086 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc66005f790 con 0x7fc660090040 2019-12-19T22:08:29.160 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.149+0000 7fc666b68700 1 --2- 172.21.15.50:0/1769968086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc660090040 0x7fc660090470 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7fc65c000b80 tx=0x7fc65c0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.160 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.150+0000 7fc6537fe700 1 -- 172.21.15.50:0/1769968086 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7fc65c0111f0 con 0x7fc660090040 2019-12-19T22:08:29.160 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.150+0000 7fc666b68700 1 --2- 172.21.15.50:0/1769968086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc660090040 0x7fc660090470 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7fc65c000b80 tx=0x7fc65c0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.160 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.150+0000 7fc6537fe700 1 --2- 172.21.15.50:0/1769968086 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fc64801f9a0 0x7fc648021eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:29.161 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.150+0000 7fc6537fe700 1 -- 172.21.15.50:0/1769968086 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3786+0+0 (secure 0 0 0) 0x7fc65c02a2d0 con 0x7fc660090040 2019-12-19T22:08:29.161 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.150+0000 7fc666367700 1 --2- 172.21.15.50:0/1769968086 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fc64801f9a0 0x7fc648021eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:29.161 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.150+0000 7fc666367700 1 --2- 172.21.15.50:0/1769968086 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fc64801f9a0 0x7fc648021eb0 crc :-1 s=READY pgs=64 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:29.161 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.150+0000 7fc6685cb700 1 -- 172.21.15.50:0/1769968086 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc660056340 con 0x7fc660090040 2019-12-19T22:08:29.161 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.154+0000 7fc666b68700 1 --2- 172.21.15.50:0/1769968086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc660090040 0x7fc660090470 secure :-1 s=THROTTLE_DONE pgs=265 cs=0 l=1 rx=0x7fc65c000b80 tx=0x7fc65c0107b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.161 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.154+0000 7fc6537fe700 1 -- 172.21.15.50:0/1769968086 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7fc65c011880 con 0x7fc660090040 2019-12-19T22:08:29.294 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.292+0000 7fc6685cb700 1 -- 172.21.15.50:0/1769968086 --> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fc660083900 con 0x7fc64801f9a0 2019-12-19T22:08:29.294 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.292+0000 7fc6537fe700 1 -- 172.21.15.50:0/1769968086 <== mgr.4103 v2:172.21.15.50:6824/27190 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (crc 0 0 0) 0x7fc660083900 con 0x7fc64801f9a0 2019-12-19T22:08:29.296 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.293+0000 7fc6685cb700 1 -- 172.21.15.50:0/1769968086 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fc64801f9a0 msgr2=0x7fc648021eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:29.296 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.293+0000 7fc6685cb700 1 --2- 172.21.15.50:0/1769968086 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fc64801f9a0 0x7fc648021eb0 crc :-1 s=READY pgs=64 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:29.296 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.293+0000 7fc6685cb700 1 -- 172.21.15.50:0/1769968086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc660090040 msgr2=0x7fc660090470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:29.296 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.293+0000 7fc6685cb700 1 --2- 172.21.15.50:0/1769968086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc660090040 0x7fc660090470 secure :-1 s=READY pgs=265 cs=0 l=1 rx=0x7fc65c000b80 tx=0x7fc65c0107b0).stop 2019-12-19T22:08:29.296 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.293+0000 7fc6685cb700 1 -- 172.21.15.50:0/1769968086 shutdown_connections 2019-12-19T22:08:29.297 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.293+0000 7fc6685cb700 1 --2- 172.21.15.50:0/1769968086 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fc64801f9a0 0x7fc648021eb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:29.297 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.293+0000 7fc6685cb700 1 --2- 172.21.15.50:0/1769968086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc660090040 0x7fc660090470 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:29.297 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.293+0000 7fc6685cb700 1 -- 172.21.15.50:0/1769968086 shutdown_connections 2019-12-19T22:08:29.297 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.293+0000 7fc6685cb700 1 -- 172.21.15.50:0/1769968086 wait complete. 2019-12-19T22:08:29.297 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.293+0000 7fc6685cb700 1 -- 172.21.15.50:0/1769968086 >> 172.21.15.50:0/1769968086 conn(0x7fc660091150 msgr2=0x7fc66007ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:29.297 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 0 to deep-scrub 2019-12-19T22:08:29.305 INFO:tasks.ceph:Scrubbing osd.1 2019-12-19T22:08:29.306 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2019-12-19T22:08:29.425 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.420+0000 7ff72b0bf700 1 Processor -- start 2019-12-19T22:08:29.425 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.420+0000 7ff72b0bf700 1 -- start start 2019-12-19T22:08:29.426 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.420+0000 7ff72b0bf700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff724089940 0x7ff724081880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:29.426 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.420+0000 7ff72b0bf700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff72408bd70 con 0x7ff724089510 2019-12-19T22:08:29.426 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.420+0000 7ff72b0bf700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff724065360 con 0x7ff724089940 2019-12-19T22:08:29.426 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.421+0000 7ff728e5b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff724089940 0x7ff724081880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:29.426 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.421+0000 7ff728e5b700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff724089940 0x7ff724081880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53978/0 (socket says 172.21.15.50:53978) 2019-12-19T22:08:29.426 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.421+0000 7ff728e5b700 1 -- 172.21.15.50:0/3168155716 learned_addr learned my addr 172.21.15.50:0/3168155716 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:29.426 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.421+0000 7ff728e5b700 1 -- 172.21.15.50:0/3168155716 >> v1:172.21.15.50:6789/0 conn(0x7ff724089510 legacy=0x7ff724081080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:29.427 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.421+0000 7ff728e5b700 1 -- 172.21.15.50:0/3168155716 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7240663a0 con 0x7ff724089940 2019-12-19T22:08:29.427 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.421+0000 7ff728e5b700 1 --2- 172.21.15.50:0/3168155716 >> v2:172.21.15.50:3300/0 conn(0x7ff724089940 0x7ff724081880 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff720008790 tx=0x7ff72000fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.427 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.421+0000 7ff728e5b700 1 --2- 172.21.15.50:0/3168155716 >> v2:172.21.15.50:3300/0 conn(0x7ff724089940 0x7ff724081880 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff720008790 tx=0x7ff72000fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.427 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.421+0000 7ff728e5b700 1 --2- 172.21.15.50:0/3168155716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff724089940 0x7ff724081880 secure :-1 s=READY pgs=267 cs=0 l=1 rx=0x7ff720008790 tx=0x7ff72000fcb0).ready entity=mon.0 client_cookie=c14f2896e2aa15c7 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:29.427 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.421+0000 7ff728e5b700 1 --2- 172.21.15.50:0/3168155716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff724089940 0x7ff724081880 secure :-1 s=THROTTLE_DONE pgs=267 cs=0 l=1 rx=0x7ff720008790 tx=0x7ff72000fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.427 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.421+0000 7ff71bfff700 1 -- 172.21.15.50:0/3168155716 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7ff720011330 con 0x7ff724089940 2019-12-19T22:08:29.427 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.421+0000 7ff728e5b700 1 --2- 172.21.15.50:0/3168155716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff724089940 0x7ff724081880 secure :-1 s=THROTTLE_DONE pgs=267 cs=0 l=1 rx=0x7ff720008790 tx=0x7ff72000fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.428 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.421+0000 7ff728e5b700 1 --2- 172.21.15.50:0/3168155716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff724089940 0x7ff724081880 secure :-1 s=THROTTLE_DONE pgs=267 cs=0 l=1 rx=0x7ff720008790 tx=0x7ff72000fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.428 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.421+0000 7ff71bfff700 1 -- 172.21.15.50:0/3168155716 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff720011530 con 0x7ff724089940 2019-12-19T22:08:29.428 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.421+0000 7ff71bfff700 1 -- 172.21.15.50:0/3168155716 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7ff720011850 con 0x7ff724089940 2019-12-19T22:08:29.428 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.421+0000 7ff72b0bf700 1 -- 172.21.15.50:0/3168155716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff724089940 msgr2=0x7ff724081880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:29.428 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.421+0000 7ff72b0bf700 1 --2- 172.21.15.50:0/3168155716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff724089940 0x7ff724081880 secure :-1 s=READY pgs=267 cs=0 l=1 rx=0x7ff720008790 tx=0x7ff72000fcb0).stop 2019-12-19T22:08:29.428 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.422+0000 7ff72b0bf700 1 -- 172.21.15.50:0/3168155716 shutdown_connections 2019-12-19T22:08:29.429 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.422+0000 7ff72b0bf700 1 --2- 172.21.15.50:0/3168155716 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff724089940 0x7ff724081880 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:29.429 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.422+0000 7ff72b0bf700 1 -- 172.21.15.50:0/3168155716 shutdown_connections 2019-12-19T22:08:29.429 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.422+0000 7ff72b0bf700 1 -- 172.21.15.50:0/3168155716 wait complete. 2019-12-19T22:08:29.429 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.422+0000 7ff72b0bf700 1 -- 172.21.15.50:0/3168155716 >> 172.21.15.50:0/3168155716 conn(0x7ff72405f610 msgr2=0x7ff724061a50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:29.430 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.423+0000 7ff72b0bf700 1 Processor -- start 2019-12-19T22:08:29.430 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.423+0000 7ff72b0bf700 1 -- start start 2019-12-19T22:08:29.436 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.423+0000 7ff72b0bf700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff7241219d0 0x7ff724123e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:29.437 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.423+0000 7ff72b0bf700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7240853e0 con 0x7ff724077040 2019-12-19T22:08:29.437 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.423+0000 7ff72b0bf700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff72405ef90 con 0x7ff7241219d0 2019-12-19T22:08:29.437 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.423+0000 7ff72965c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff724077040 0x7ff724077470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40110/0 (socket says 172.21.15.50:40110) 2019-12-19T22:08:29.437 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.423+0000 7ff72965c700 1 -- 172.21.15.50:0/1089576531 learned_addr learned my addr 172.21.15.50:0/1089576531 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:29.437 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.423+0000 7ff728e5b700 1 --2- 172.21.15.50:0/1089576531 >> v2:172.21.15.50:3300/0 conn(0x7ff7241219d0 0x7ff724123e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:29.437 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.423+0000 7ff719ffb700 1 -- 172.21.15.50:0/1089576531 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3525592251 0 0) 0x7ff7240853e0 con 0x7ff724077040 2019-12-19T22:08:29.437 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.423+0000 7ff719ffb700 1 -- 172.21.15.50:0/1089576531 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7040030b0 con 0x7ff724077040 2019-12-19T22:08:29.438 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.424+0000 7ff728e5b700 1 -- 172.21.15.50:0/1089576531 >> v1:172.21.15.50:6789/0 conn(0x7ff724077040 legacy=0x7ff724077470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:29.438 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.424+0000 7ff728e5b700 1 -- 172.21.15.50:0/1089576531 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff724083c90 con 0x7ff7241219d0 2019-12-19T22:08:29.438 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.424+0000 7ff728e5b700 1 --2- 172.21.15.50:0/1089576531 >> v2:172.21.15.50:3300/0 conn(0x7ff7241219d0 0x7ff724123e10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff720008790 tx=0x7ff72000f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.438 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.424+0000 7ff728e5b700 1 --2- 172.21.15.50:0/1089576531 >> v2:172.21.15.50:3300/0 conn(0x7ff7241219d0 0x7ff724123e10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff720008790 tx=0x7ff72000f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.438 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.424+0000 7ff728e5b700 1 --2- 172.21.15.50:0/1089576531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7241219d0 0x7ff724123e10 secure :-1 s=READY pgs=269 cs=0 l=1 rx=0x7ff720008790 tx=0x7ff72000f780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:29.438 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.424+0000 7ff728e5b700 1 --2- 172.21.15.50:0/1089576531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7241219d0 0x7ff724123e10 secure :-1 s=THROTTLE_DONE pgs=269 cs=0 l=1 rx=0x7ff720008790 tx=0x7ff72000f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.438 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.424+0000 7ff719ffb700 1 -- 172.21.15.50:0/1089576531 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7ff720007280 con 0x7ff7241219d0 2019-12-19T22:08:29.439 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.424+0000 7ff728e5b700 1 --2- 172.21.15.50:0/1089576531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7241219d0 0x7ff724123e10 secure :-1 s=THROTTLE_DONE pgs=269 cs=0 l=1 rx=0x7ff720008790 tx=0x7ff72000f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.439 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.424+0000 7ff72b0bf700 1 -- 172.21.15.50:0/1089576531 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff724085030 con 0x7ff7241219d0 2019-12-19T22:08:29.439 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.424+0000 7ff719ffb700 1 -- 172.21.15.50:0/1089576531 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7200115c0 con 0x7ff7241219d0 2019-12-19T22:08:29.439 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.424+0000 7ff728e5b700 1 --2- 172.21.15.50:0/1089576531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7241219d0 0x7ff724123e10 secure :-1 s=THROTTLE_DONE pgs=269 cs=0 l=1 rx=0x7ff720008790 tx=0x7ff72000f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.439 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.424+0000 7ff719ffb700 1 -- 172.21.15.50:0/1089576531 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7ff7200118e0 con 0x7ff7241219d0 2019-12-19T22:08:29.440 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.424+0000 7ff72b0bf700 1 -- 172.21.15.50:0/1089576531 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff724077c70 con 0x7ff7241219d0 2019-12-19T22:08:29.440 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.424+0000 7ff728e5b700 1 --2- 172.21.15.50:0/1089576531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7241219d0 0x7ff724123e10 secure :-1 s=THROTTLE_DONE pgs=269 cs=0 l=1 rx=0x7ff720008790 tx=0x7ff72000f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.440 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.424+0000 7ff719ffb700 1 -- 172.21.15.50:0/1089576531 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7ff720005540 con 0x7ff7241219d0 2019-12-19T22:08:29.440 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.424+0000 7ff728e5b700 1 --2- 172.21.15.50:0/1089576531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7241219d0 0x7ff724123e10 secure :-1 s=THROTTLE_DONE pgs=269 cs=0 l=1 rx=0x7ff720008790 tx=0x7ff72000f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.440 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.424+0000 7ff719ffb700 1 --2- 172.21.15.50:0/1089576531 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7ff70401fff0 0x7ff704022500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:29.440 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.424+0000 7ff719ffb700 1 -- 172.21.15.50:0/1089576531 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3786+0+0 (secure 0 0 0) 0x7ff72002a9a0 con 0x7ff7241219d0 2019-12-19T22:08:29.441 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.425+0000 7ff72965c700 1 --2- 172.21.15.50:0/1089576531 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7ff70401fff0 0x7ff704022500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:29.441 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.425+0000 7ff72b0bf700 1 --2- 172.21.15.50:0/1089576531 >> [v2:172.21.15.50:6800/27758,v1:172.21.15.50:6801/27758] conn(0x7ff6fc001600 0x7ff6fc003b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:29.441 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.425+0000 7ff72b0bf700 1 -- 172.21.15.50:0/1089576531 --> [v2:172.21.15.50:6800/27758,v1:172.21.15.50:6801/27758] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff6fc0066d0 con 0x7ff6fc001600 2019-12-19T22:08:29.441 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.425+0000 7ff72965c700 1 --2- 172.21.15.50:0/1089576531 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7ff70401fff0 0x7ff704022500 crc :-1 s=READY pgs=65 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:29.441 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.425+0000 7ff729e5d700 1 --2- 172.21.15.50:0/1089576531 >> [v2:172.21.15.50:6800/27758,v1:172.21.15.50:6801/27758] conn(0x7ff6fc001600 0x7ff6fc003b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:29.441 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.425+0000 7ff729e5d700 1 --2- 172.21.15.50:0/1089576531 >> [v2:172.21.15.50:6800/27758,v1:172.21.15.50:6801/27758] conn(0x7ff6fc001600 0x7ff6fc003b10 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:29.441 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.426+0000 7ff719ffb700 1 -- 172.21.15.50:0/1089576531 <== osd.1 v2:172.21.15.50:6800/27758 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23187 (crc 0 0 0) 0x7ff6fc0066d0 con 0x7ff6fc001600 2019-12-19T22:08:29.446 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.443+0000 7ff72b0bf700 1 -- 172.21.15.50:0/1089576531 --> [v2:172.21.15.50:6800/27758,v1:172.21.15.50:6801/27758] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff6fc0057d0 con 0x7ff6fc001600 2019-12-19T22:08:29.447 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.443+0000 7ff719ffb700 1 -- 172.21.15.50:0/1089576531 <== osd.1 v2:172.21.15.50:6800/27758 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ff6fc0057d0 con 0x7ff6fc001600 2019-12-19T22:08:29.447 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.443+0000 7ff72b0bf700 1 -- 172.21.15.50:0/1089576531 >> [v2:172.21.15.50:6800/27758,v1:172.21.15.50:6801/27758] conn(0x7ff6fc001600 msgr2=0x7ff6fc003b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:29.447 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.443+0000 7ff72b0bf700 1 --2- 172.21.15.50:0/1089576531 >> [v2:172.21.15.50:6800/27758,v1:172.21.15.50:6801/27758] conn(0x7ff6fc001600 0x7ff6fc003b10 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:29.447 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.443+0000 7ff72b0bf700 1 -- 172.21.15.50:0/1089576531 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7ff70401fff0 msgr2=0x7ff704022500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:29.447 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.443+0000 7ff72b0bf700 1 --2- 172.21.15.50:0/1089576531 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7ff70401fff0 0x7ff704022500 crc :-1 s=READY pgs=65 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:29.447 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.443+0000 7ff72b0bf700 1 -- 172.21.15.50:0/1089576531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7241219d0 msgr2=0x7ff724123e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:29.447 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.443+0000 7ff72b0bf700 1 --2- 172.21.15.50:0/1089576531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7241219d0 0x7ff724123e10 secure :-1 s=READY pgs=269 cs=0 l=1 rx=0x7ff720008790 tx=0x7ff72000f780).stop 2019-12-19T22:08:29.448 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.444+0000 7ff72b0bf700 1 -- 172.21.15.50:0/1089576531 shutdown_connections 2019-12-19T22:08:29.448 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.444+0000 7ff72b0bf700 1 --2- 172.21.15.50:0/1089576531 >> [v2:172.21.15.50:6800/27758,v1:172.21.15.50:6801/27758] conn(0x7ff6fc001600 0x7ff6fc003b10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:29.448 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.444+0000 7ff72b0bf700 1 --2- 172.21.15.50:0/1089576531 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7ff70401fff0 0x7ff704022500 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:29.448 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.444+0000 7ff72b0bf700 1 --2- 172.21.15.50:0/1089576531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff7241219d0 0x7ff724123e10 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:29.448 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.444+0000 7ff72b0bf700 1 -- 172.21.15.50:0/1089576531 shutdown_connections 2019-12-19T22:08:29.448 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.444+0000 7ff72b0bf700 1 -- 172.21.15.50:0/1089576531 wait complete. 2019-12-19T22:08:29.449 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.444+0000 7ff72b0bf700 1 -- 172.21.15.50:0/1089576531 >> 172.21.15.50:0/1089576531 conn(0x7ff724064110 msgr2=0x7ff724080970 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:29.449 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2019-12-19T22:08:29.449 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2019-12-19T22:08:29.449 INFO:teuthology.orchestra.run.smithi050.stdout:} 2019-12-19T22:08:29.456 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2019-12-19T22:08:29.572 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.567+0000 7f7a3aba5700 1 Processor -- start 2019-12-19T22:08:29.573 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.568+0000 7f7a3aba5700 1 -- start start 2019-12-19T22:08:29.573 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.568+0000 7f7a3aba5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7a340898b0 0x7f7a34081170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:29.573 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.568+0000 7f7a3aba5700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a34089ce0 con 0x7f7a34089480 2019-12-19T22:08:29.573 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.568+0000 7f7a3aba5700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a3408ae60 con 0x7f7a340898b0 2019-12-19T22:08:29.573 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.568+0000 7f7a38941700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7a340898b0 0x7f7a34081170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:29.573 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.568+0000 7f7a38941700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7a340898b0 0x7f7a34081170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53990/0 (socket says 172.21.15.50:53990) 2019-12-19T22:08:29.574 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.568+0000 7f7a38941700 1 -- 172.21.15.50:0/2725264999 learned_addr learned my addr 172.21.15.50:0/2725264999 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:29.574 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.568+0000 7f7a38941700 1 -- 172.21.15.50:0/2725264999 >> v1:172.21.15.50:6789/0 conn(0x7f7a34089480 legacy=0x7f7a3408f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:29.574 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.568+0000 7f7a38941700 1 -- 172.21.15.50:0/2725264999 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a3408edb0 con 0x7f7a340898b0 2019-12-19T22:08:29.574 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.568+0000 7f7a38941700 1 --2- 172.21.15.50:0/2725264999 >> v2:172.21.15.50:3300/0 conn(0x7f7a340898b0 0x7f7a34081170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7a24008790 tx=0x7f7a2400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.574 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.568+0000 7f7a38941700 1 --2- 172.21.15.50:0/2725264999 >> v2:172.21.15.50:3300/0 conn(0x7f7a340898b0 0x7f7a34081170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7a24008790 tx=0x7f7a2400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.574 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.568+0000 7f7a38941700 1 --2- 172.21.15.50:0/2725264999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a340898b0 0x7f7a34081170 secure :-1 s=READY pgs=271 cs=0 l=1 rx=0x7f7a24008790 tx=0x7f7a2400fcb0).ready entity=mon.0 client_cookie=f1e3946c60c0371e server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:29.575 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.569+0000 7f7a38941700 1 --2- 172.21.15.50:0/2725264999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a340898b0 0x7f7a34081170 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7f7a24008790 tx=0x7f7a2400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.575 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.569+0000 7f7a2bfff700 1 -- 172.21.15.50:0/2725264999 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f7a24011330 con 0x7f7a340898b0 2019-12-19T22:08:29.575 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.569+0000 7f7a38941700 1 --2- 172.21.15.50:0/2725264999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a340898b0 0x7f7a34081170 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7f7a24008790 tx=0x7f7a2400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.575 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.569+0000 7f7a38941700 1 --2- 172.21.15.50:0/2725264999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a340898b0 0x7f7a34081170 secure :-1 s=THROTTLE_DONE pgs=271 cs=0 l=1 rx=0x7f7a24008790 tx=0x7f7a2400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.575 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.569+0000 7f7a2bfff700 1 -- 172.21.15.50:0/2725264999 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a24011530 con 0x7f7a340898b0 2019-12-19T22:08:29.575 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.569+0000 7f7a2bfff700 1 -- 172.21.15.50:0/2725264999 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f7a24011850 con 0x7f7a340898b0 2019-12-19T22:08:29.576 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.569+0000 7f7a3aba5700 1 -- 172.21.15.50:0/2725264999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a340898b0 msgr2=0x7f7a34081170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:29.576 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.569+0000 7f7a3aba5700 1 --2- 172.21.15.50:0/2725264999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a340898b0 0x7f7a34081170 secure :-1 s=READY pgs=271 cs=0 l=1 rx=0x7f7a24008790 tx=0x7f7a2400fcb0).stop 2019-12-19T22:08:29.576 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.569+0000 7f7a3aba5700 1 -- 172.21.15.50:0/2725264999 shutdown_connections 2019-12-19T22:08:29.576 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.569+0000 7f7a3aba5700 1 --2- 172.21.15.50:0/2725264999 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a340898b0 0x7f7a34081170 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:29.576 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.569+0000 7f7a3aba5700 1 -- 172.21.15.50:0/2725264999 shutdown_connections 2019-12-19T22:08:29.576 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.569+0000 7f7a3aba5700 1 -- 172.21.15.50:0/2725264999 wait complete. 2019-12-19T22:08:29.577 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.569+0000 7f7a3aba5700 1 -- 172.21.15.50:0/2725264999 >> 172.21.15.50:0/2725264999 conn(0x7f7a34067e70 msgr2=0x7f7a34094570 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:29.577 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.570+0000 7f7a3aba5700 1 Processor -- start 2019-12-19T22:08:29.577 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.570+0000 7f7a3aba5700 1 -- start start 2019-12-19T22:08:29.580 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.571+0000 7f7a3aba5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7a34124b50 0x7f7a34126f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:29.580 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.571+0000 7f7a3aba5700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a340663a0 con 0x7f7a34063a20 2019-12-19T22:08:29.580 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.571+0000 7f7a3aba5700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a34090860 con 0x7f7a34124b50 2019-12-19T22:08:29.580 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.571+0000 7f7a38941700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7a34124b50 0x7f7a34126f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:29.580 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.571+0000 7f7a38941700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f7a34124b50 0x7f7a34126f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:53994/0 (socket says 172.21.15.50:53994) 2019-12-19T22:08:29.580 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.571+0000 7f7a38941700 1 -- 172.21.15.50:0/2844521119 learned_addr learned my addr 172.21.15.50:0/2844521119 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:29.581 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.571+0000 7f7a39142700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f7a34063a20 0x7f7a34063e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40120/0 (socket says 172.21.15.50:40120) 2019-12-19T22:08:29.581 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.571+0000 7f7a38941700 1 -- 172.21.15.50:0/2844521119 >> v1:172.21.15.50:6789/0 conn(0x7f7a34063a20 legacy=0x7f7a34063e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:29.581 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.571+0000 7f7a29ffb700 1 -- 172.21.15.50:0/2844521119 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3554404740 0 0) 0x7f7a340663a0 con 0x7f7a34063a20 2019-12-19T22:08:29.581 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.571+0000 7f7a38941700 1 -- 172.21.15.50:0/2844521119 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a34064d70 con 0x7f7a34124b50 2019-12-19T22:08:29.581 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.571+0000 7f7a38941700 1 --2- 172.21.15.50:0/2844521119 >> v2:172.21.15.50:3300/0 conn(0x7f7a34124b50 0x7f7a34126f90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7a24008790 tx=0x7f7a2400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.581 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.571+0000 7f7a38941700 1 --2- 172.21.15.50:0/2844521119 >> v2:172.21.15.50:3300/0 conn(0x7f7a34124b50 0x7f7a34126f90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7a24008790 tx=0x7f7a2400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.581 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.571+0000 7f7a38941700 1 --2- 172.21.15.50:0/2844521119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a34124b50 0x7f7a34126f90 secure :-1 s=READY pgs=273 cs=0 l=1 rx=0x7f7a24008790 tx=0x7f7a2400f780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:29.582 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.571+0000 7f7a38941700 1 --2- 172.21.15.50:0/2844521119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a34124b50 0x7f7a34126f90 secure :-1 s=THROTTLE_DONE pgs=273 cs=0 l=1 rx=0x7f7a24008790 tx=0x7f7a2400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.582 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.571+0000 7f7a29ffb700 1 -- 172.21.15.50:0/2844521119 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f7a24007280 con 0x7f7a34124b50 2019-12-19T22:08:29.582 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.571+0000 7f7a38941700 1 --2- 172.21.15.50:0/2844521119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a34124b50 0x7f7a34126f90 secure :-1 s=THROTTLE_DONE pgs=273 cs=0 l=1 rx=0x7f7a24008790 tx=0x7f7a2400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.582 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.571+0000 7f7a38941700 1 --2- 172.21.15.50:0/2844521119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a34124b50 0x7f7a34126f90 secure :-1 s=THROTTLE_DONE pgs=273 cs=0 l=1 rx=0x7f7a24008790 tx=0x7f7a2400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.582 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.571+0000 7f7a29ffb700 1 -- 172.21.15.50:0/2844521119 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a24011640 con 0x7f7a34124b50 2019-12-19T22:08:29.582 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.571+0000 7f7a3aba5700 1 -- 172.21.15.50:0/2844521119 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a34065110 con 0x7f7a34124b50 2019-12-19T22:08:29.583 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.571+0000 7f7a29ffb700 1 -- 172.21.15.50:0/2844521119 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f7a24005540 con 0x7f7a34124b50 2019-12-19T22:08:29.583 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.571+0000 7f7a3aba5700 1 -- 172.21.15.50:0/2844521119 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a34065410 con 0x7f7a34124b50 2019-12-19T22:08:29.583 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.572+0000 7f7a38941700 1 --2- 172.21.15.50:0/2844521119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a34124b50 0x7f7a34126f90 secure :-1 s=THROTTLE_DONE pgs=273 cs=0 l=1 rx=0x7f7a24008790 tx=0x7f7a2400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.583 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.572+0000 7f7a29ffb700 1 -- 172.21.15.50:0/2844521119 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7f7a240057d0 con 0x7f7a34124b50 2019-12-19T22:08:29.583 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.572+0000 7f7a38941700 1 --2- 172.21.15.50:0/2844521119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a34124b50 0x7f7a34126f90 secure :-1 s=THROTTLE_DONE pgs=273 cs=0 l=1 rx=0x7f7a24008790 tx=0x7f7a2400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.583 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.572+0000 7f7a29ffb700 1 --2- 172.21.15.50:0/2844521119 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f7a1401fa20 0x7f7a14021f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:29.583 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.572+0000 7f7a29ffb700 1 -- 172.21.15.50:0/2844521119 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3786+0+0 (secure 0 0 0) 0x7f7a2402aa90 con 0x7f7a34124b50 2019-12-19T22:08:29.584 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.572+0000 7f7a39142700 1 --2- 172.21.15.50:0/2844521119 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f7a1401fa20 0x7f7a14021f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:29.584 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.572+0000 7f7a39142700 1 --2- 172.21.15.50:0/2844521119 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f7a1401fa20 0x7f7a14021f30 crc :-1 s=READY pgs=66 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:29.584 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.572+0000 7f7a3aba5700 1 -- 172.21.15.50:0/2844521119 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a34056340 con 0x7f7a34124b50 2019-12-19T22:08:29.584 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.576+0000 7f7a38941700 1 --2- 172.21.15.50:0/2844521119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a34124b50 0x7f7a34126f90 secure :-1 s=THROTTLE_DONE pgs=273 cs=0 l=1 rx=0x7f7a24008790 tx=0x7f7a2400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.584 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.576+0000 7f7a29ffb700 1 -- 172.21.15.50:0/2844521119 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7f7a2402a570 con 0x7f7a34124b50 2019-12-19T22:08:29.715 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.712+0000 7f7a3aba5700 1 -- 172.21.15.50:0/2844521119 --> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f7a3408dcf0 con 0x7f7a1401fa20 2019-12-19T22:08:29.715 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.712+0000 7f7a29ffb700 1 -- 172.21.15.50:0/2844521119 <== mgr.4103 v2:172.21.15.50:6824/27190 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (crc 0 0 0) 0x7f7a3408dcf0 con 0x7f7a1401fa20 2019-12-19T22:08:29.717 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.714+0000 7f7a3aba5700 1 -- 172.21.15.50:0/2844521119 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f7a1401fa20 msgr2=0x7f7a14021f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:29.717 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.714+0000 7f7a3aba5700 1 --2- 172.21.15.50:0/2844521119 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f7a1401fa20 0x7f7a14021f30 crc :-1 s=READY pgs=66 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:29.718 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.714+0000 7f7a3aba5700 1 -- 172.21.15.50:0/2844521119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a34124b50 msgr2=0x7f7a34126f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:29.718 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.714+0000 7f7a3aba5700 1 --2- 172.21.15.50:0/2844521119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a34124b50 0x7f7a34126f90 secure :-1 s=READY pgs=273 cs=0 l=1 rx=0x7f7a24008790 tx=0x7f7a2400f780).stop 2019-12-19T22:08:29.718 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.714+0000 7f7a3aba5700 1 -- 172.21.15.50:0/2844521119 shutdown_connections 2019-12-19T22:08:29.718 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.714+0000 7f7a3aba5700 1 --2- 172.21.15.50:0/2844521119 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f7a1401fa20 0x7f7a14021f30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:29.718 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.714+0000 7f7a3aba5700 1 --2- 172.21.15.50:0/2844521119 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7a34124b50 0x7f7a34126f90 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:29.718 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.714+0000 7f7a3aba5700 1 -- 172.21.15.50:0/2844521119 shutdown_connections 2019-12-19T22:08:29.718 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.714+0000 7f7a3aba5700 1 -- 172.21.15.50:0/2844521119 wait complete. 2019-12-19T22:08:29.719 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.714+0000 7f7a3aba5700 1 -- 172.21.15.50:0/2844521119 >> 172.21.15.50:0/2844521119 conn(0x7f7a34091150 msgr2=0x7f7a3407ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:29.719 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 1 to deep-scrub 2019-12-19T22:08:29.731 INFO:tasks.ceph:Scrubbing osd.2 2019-12-19T22:08:29.732 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2019-12-19T22:08:29.859 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.847+0000 7f6c64fc5700 1 Processor -- start 2019-12-19T22:08:29.863 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.847+0000 7f6c64fc5700 1 -- start start 2019-12-19T22:08:29.863 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.848+0000 7f6c64fc5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6c60089510 0x7f6c60089940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:29.863 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.848+0000 7f6c64fc5700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c6008bd70 con 0x7f6c60081080 2019-12-19T22:08:29.863 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.848+0000 7f6c64fc5700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c60065360 con 0x7f6c60089510 2019-12-19T22:08:29.864 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.848+0000 7f6c5ed9d700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6c60089510 0x7f6c60089940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:29.867 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.848+0000 7f6c5e59c700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6c60081080 0x7f6c600814b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40126/0 (socket says 172.21.15.50:40126) 2019-12-19T22:08:29.867 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.848+0000 7f6c5e59c700 1 -- 172.21.15.50:0/3472752664 learned_addr learned my addr 172.21.15.50:0/3472752664 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:29.868 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.848+0000 7f6c5ed9d700 1 -- 172.21.15.50:0/3472752664 >> v1:172.21.15.50:6789/0 conn(0x7f6c60081080 legacy=0x7f6c600814b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:29.868 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.848+0000 7f6c5dd9b700 1 -- 172.21.15.50:0/3472752664 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2592868754 0 0) 0x7f6c6008bd70 con 0x7f6c60081080 2019-12-19T22:08:29.868 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.848+0000 7f6c5ed9d700 1 -- 172.21.15.50:0/3472752664 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c60089e90 con 0x7f6c60089510 2019-12-19T22:08:29.868 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.848+0000 7f6c5ed9d700 1 --2- 172.21.15.50:0/3472752664 >> v2:172.21.15.50:3300/0 conn(0x7f6c60089510 0x7f6c60089940 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6c50002f30 tx=0x7f6c5000fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.869 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.848+0000 7f6c5ed9d700 1 --2- 172.21.15.50:0/3472752664 >> v2:172.21.15.50:3300/0 conn(0x7f6c60089510 0x7f6c60089940 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6c50002f30 tx=0x7f6c5000fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.869 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.848+0000 7f6c5ed9d700 1 --2- 172.21.15.50:0/3472752664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c60089510 0x7f6c60089940 secure :-1 s=READY pgs=275 cs=0 l=1 rx=0x7f6c50002f30 tx=0x7f6c5000fbf0).ready entity=mon.0 client_cookie=20e89330868d0293 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:29.869 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.848+0000 7f6c5ed9d700 1 --2- 172.21.15.50:0/3472752664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c60089510 0x7f6c60089940 secure :-1 s=THROTTLE_DONE pgs=275 cs=0 l=1 rx=0x7f6c50002f30 tx=0x7f6c5000fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.869 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.848+0000 7f6c5dd9b700 1 -- 172.21.15.50:0/3472752664 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f6c50011230 con 0x7f6c60089510 2019-12-19T22:08:29.870 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.848+0000 7f6c5ed9d700 1 --2- 172.21.15.50:0/3472752664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c60089510 0x7f6c60089940 secure :-1 s=THROTTLE_DONE pgs=275 cs=0 l=1 rx=0x7f6c50002f30 tx=0x7f6c5000fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.870 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.848+0000 7f6c5dd9b700 1 -- 172.21.15.50:0/3472752664 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c50011430 con 0x7f6c60089510 2019-12-19T22:08:29.870 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.848+0000 7f6c5ed9d700 1 --2- 172.21.15.50:0/3472752664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c60089510 0x7f6c60089940 secure :-1 s=THROTTLE_DONE pgs=275 cs=0 l=1 rx=0x7f6c50002f30 tx=0x7f6c5000fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.870 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.848+0000 7f6c5dd9b700 1 -- 172.21.15.50:0/3472752664 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f6c50011750 con 0x7f6c60089510 2019-12-19T22:08:29.871 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.848+0000 7f6c64fc5700 1 -- 172.21.15.50:0/3472752664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c60089510 msgr2=0x7f6c60089940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:29.871 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.848+0000 7f6c64fc5700 1 --2- 172.21.15.50:0/3472752664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c60089510 0x7f6c60089940 secure :-1 s=READY pgs=275 cs=0 l=1 rx=0x7f6c50002f30 tx=0x7f6c5000fbf0).stop 2019-12-19T22:08:29.871 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.849+0000 7f6c64fc5700 1 -- 172.21.15.50:0/3472752664 shutdown_connections 2019-12-19T22:08:29.871 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.849+0000 7f6c64fc5700 1 --2- 172.21.15.50:0/3472752664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c60089510 0x7f6c60089940 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:29.872 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.849+0000 7f6c64fc5700 1 -- 172.21.15.50:0/3472752664 shutdown_connections 2019-12-19T22:08:29.872 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.849+0000 7f6c64fc5700 1 -- 172.21.15.50:0/3472752664 wait complete. 2019-12-19T22:08:29.872 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.849+0000 7f6c64fc5700 1 -- 172.21.15.50:0/3472752664 >> 172.21.15.50:0/3472752664 conn(0x7f6c6005f610 msgr2=0x7f6c60061a50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:29.874 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.850+0000 7f6c64fc5700 1 Processor -- start 2019-12-19T22:08:29.874 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.850+0000 7f6c64fc5700 1 -- start start 2019-12-19T22:08:29.875 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.850+0000 7f6c64fc5700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f6c60124b50 0x7f6c60126f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:29.878 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.850+0000 7f6c64fc5700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c600827a0 con 0x7f6c6007f860 2019-12-19T22:08:29.878 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.850+0000 7f6c64fc5700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c6005ef90 con 0x7f6c60124b50 2019-12-19T22:08:29.879 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.850+0000 7f6c5ed9d700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f6c6007f860 0x7f6c6007fc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40130/0 (socket says 172.21.15.50:40130) 2019-12-19T22:08:29.880 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.850+0000 7f6c5ed9d700 1 -- 172.21.15.50:0/2831594643 learned_addr learned my addr 172.21.15.50:0/2831594643 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:29.880 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.850+0000 7f6c5e59c700 1 --2- 172.21.15.50:0/2831594643 >> v2:172.21.15.50:3300/0 conn(0x7f6c60124b50 0x7f6c60126f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:29.880 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.851+0000 7f6c5e59c700 1 -- 172.21.15.50:0/2831594643 >> v1:172.21.15.50:6789/0 conn(0x7f6c6007f860 legacy=0x7f6c6007fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:29.880 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.851+0000 7f6c5e59c700 1 -- 172.21.15.50:0/2831594643 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c6007ae90 con 0x7f6c60124b50 2019-12-19T22:08:29.880 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.851+0000 7f6c577fe700 1 -- 172.21.15.50:0/2831594643 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2270504878 0 0) 0x7f6c600827a0 con 0x7f6c6007f860 2019-12-19T22:08:29.881 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.851+0000 7f6c5e59c700 1 --2- 172.21.15.50:0/2831594643 >> v2:172.21.15.50:3300/0 conn(0x7f6c60124b50 0x7f6c60126f90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6c4c0043a0 tx=0x7f6c4c010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.881 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.851+0000 7f6c5e59c700 1 --2- 172.21.15.50:0/2831594643 >> v2:172.21.15.50:3300/0 conn(0x7f6c60124b50 0x7f6c60126f90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6c4c0043a0 tx=0x7f6c4c010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.881 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.851+0000 7f6c5e59c700 1 --2- 172.21.15.50:0/2831594643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c60124b50 0x7f6c60126f90 secure :-1 s=READY pgs=277 cs=0 l=1 rx=0x7f6c4c0043a0 tx=0x7f6c4c010820).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:29.881 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.851+0000 7f6c5e59c700 1 --2- 172.21.15.50:0/2831594643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c60124b50 0x7f6c60126f90 secure :-1 s=THROTTLE_DONE pgs=277 cs=0 l=1 rx=0x7f6c4c0043a0 tx=0x7f6c4c010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.881 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.851+0000 7f6c577fe700 1 -- 172.21.15.50:0/2831594643 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f6c4c0114c0 con 0x7f6c60124b50 2019-12-19T22:08:29.882 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.851+0000 7f6c5e59c700 1 --2- 172.21.15.50:0/2831594643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c60124b50 0x7f6c60126f90 secure :-1 s=THROTTLE_DONE pgs=277 cs=0 l=1 rx=0x7f6c4c0043a0 tx=0x7f6c4c010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.882 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.851+0000 7f6c577fe700 1 -- 172.21.15.50:0/2831594643 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4c0116c0 con 0x7f6c60124b50 2019-12-19T22:08:29.882 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.851+0000 7f6c5e59c700 1 --2- 172.21.15.50:0/2831594643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c60124b50 0x7f6c60126f90 secure :-1 s=THROTTLE_DONE pgs=277 cs=0 l=1 rx=0x7f6c4c0043a0 tx=0x7f6c4c010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.882 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.851+0000 7f6c64fc5700 1 -- 172.21.15.50:0/2831594643 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c600839a0 con 0x7f6c60124b50 2019-12-19T22:08:29.882 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.851+0000 7f6c577fe700 1 -- 172.21.15.50:0/2831594643 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f6c4c0119e0 con 0x7f6c60124b50 2019-12-19T22:08:29.883 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.851+0000 7f6c64fc5700 1 -- 172.21.15.50:0/2831594643 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c6007a8e0 con 0x7f6c60124b50 2019-12-19T22:08:29.883 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.851+0000 7f6c5e59c700 1 --2- 172.21.15.50:0/2831594643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c60124b50 0x7f6c60126f90 secure :-1 s=THROTTLE_DONE pgs=277 cs=0 l=1 rx=0x7f6c4c0043a0 tx=0x7f6c4c010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.883 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.851+0000 7f6c5e59c700 1 --2- 172.21.15.50:0/2831594643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c60124b50 0x7f6c60126f90 secure :-1 s=THROTTLE_DONE pgs=277 cs=0 l=1 rx=0x7f6c4c0043a0 tx=0x7f6c4c010820).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:29.883 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.851+0000 7f6c577fe700 1 -- 172.21.15.50:0/2831594643 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7f6c4c00b330 con 0x7f6c60124b50 2019-12-19T22:08:29.884 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.852+0000 7f6c577fe700 1 --2- 172.21.15.50:0/2831594643 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f6c3c01f9d0 0x7f6c3c021ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:29.884 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.852+0000 7f6c577fe700 1 -- 172.21.15.50:0/2831594643 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3786+0+0 (secure 0 0 0) 0x7f6c4c02a450 con 0x7f6c60124b50 2019-12-19T22:08:29.884 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.852+0000 7f6c5ed9d700 1 --2- 172.21.15.50:0/2831594643 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f6c3c01f9d0 0x7f6c3c021ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:29.884 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.852+0000 7f6c5ed9d700 1 --2- 172.21.15.50:0/2831594643 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f6c3c01f9d0 0x7f6c3c021ee0 crc :-1 s=READY pgs=67 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:29.884 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.852+0000 7f6c64fc5700 1 --2- 172.21.15.50:0/2831594643 >> [v2:172.21.15.50:6804/27759,v1:172.21.15.50:6806/27759] conn(0x7f6c60081170 0x7f6c600550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:29.884 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.852+0000 7f6c64fc5700 1 -- 172.21.15.50:0/2831594643 --> [v2:172.21.15.50:6804/27759,v1:172.21.15.50:6806/27759] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6c6005dc90 con 0x7f6c60081170 2019-12-19T22:08:29.885 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.852+0000 7f6c5f59e700 1 --2- 172.21.15.50:0/2831594643 >> [v2:172.21.15.50:6804/27759,v1:172.21.15.50:6806/27759] conn(0x7f6c60081170 0x7f6c600550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:29.885 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.852+0000 7f6c5f59e700 1 --2- 172.21.15.50:0/2831594643 >> [v2:172.21.15.50:6804/27759,v1:172.21.15.50:6806/27759] conn(0x7f6c60081170 0x7f6c600550c0 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:29.885 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.853+0000 7f6c577fe700 1 -- 172.21.15.50:0/2831594643 <== osd.2 v2:172.21.15.50:6804/27759 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23187 (crc 0 0 0) 0x7f6c6005dc90 con 0x7f6c60081170 2019-12-19T22:08:29.888 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.870+0000 7f6c64fc5700 1 -- 172.21.15.50:0/2831594643 --> [v2:172.21.15.50:6804/27759,v1:172.21.15.50:6806/27759] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6c60055610 con 0x7f6c60081170 2019-12-19T22:08:29.889 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.870+0000 7f6c577fe700 1 -- 172.21.15.50:0/2831594643 <== osd.2 v2:172.21.15.50:6804/27759 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f6c60055610 con 0x7f6c60081170 2019-12-19T22:08:29.889 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.870+0000 7f6c64fc5700 1 -- 172.21.15.50:0/2831594643 >> [v2:172.21.15.50:6804/27759,v1:172.21.15.50:6806/27759] conn(0x7f6c60081170 msgr2=0x7f6c600550c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:29.889 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.870+0000 7f6c64fc5700 1 --2- 172.21.15.50:0/2831594643 >> [v2:172.21.15.50:6804/27759,v1:172.21.15.50:6806/27759] conn(0x7f6c60081170 0x7f6c600550c0 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:29.889 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.870+0000 7f6c64fc5700 1 -- 172.21.15.50:0/2831594643 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f6c3c01f9d0 msgr2=0x7f6c3c021ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:29.889 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.870+0000 7f6c64fc5700 1 --2- 172.21.15.50:0/2831594643 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f6c3c01f9d0 0x7f6c3c021ee0 crc :-1 s=READY pgs=67 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:29.889 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.870+0000 7f6c64fc5700 1 -- 172.21.15.50:0/2831594643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c60124b50 msgr2=0x7f6c60126f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:29.890 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.870+0000 7f6c64fc5700 1 --2- 172.21.15.50:0/2831594643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c60124b50 0x7f6c60126f90 secure :-1 s=READY pgs=277 cs=0 l=1 rx=0x7f6c4c0043a0 tx=0x7f6c4c010820).stop 2019-12-19T22:08:29.890 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.871+0000 7f6c64fc5700 1 -- 172.21.15.50:0/2831594643 shutdown_connections 2019-12-19T22:08:29.890 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.871+0000 7f6c64fc5700 1 --2- 172.21.15.50:0/2831594643 >> [v2:172.21.15.50:6804/27759,v1:172.21.15.50:6806/27759] conn(0x7f6c60081170 0x7f6c600550c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:29.890 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.871+0000 7f6c64fc5700 1 --2- 172.21.15.50:0/2831594643 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f6c3c01f9d0 0x7f6c3c021ee0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:29.891 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.871+0000 7f6c64fc5700 1 --2- 172.21.15.50:0/2831594643 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c60124b50 0x7f6c60126f90 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:29.891 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.871+0000 7f6c64fc5700 1 -- 172.21.15.50:0/2831594643 shutdown_connections 2019-12-19T22:08:29.891 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.871+0000 7f6c64fc5700 1 -- 172.21.15.50:0/2831594643 wait complete. 2019-12-19T22:08:29.891 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:29.871+0000 7f6c64fc5700 1 -- 172.21.15.50:0/2831594643 >> 172.21.15.50:0/2831594643 conn(0x7f6c6007f2b0 msgr2=0x7f6c60080970 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:29.891 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2019-12-19T22:08:29.892 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2019-12-19T22:08:29.892 INFO:teuthology.orchestra.run.smithi050.stdout:} 2019-12-19T22:08:29.892 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2019-12-19T22:08:30.012 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.007+0000 7f11dbc24700 1 Processor -- start 2019-12-19T22:08:30.012 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.007+0000 7f11dbc24700 1 -- start start 2019-12-19T22:08:30.012 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.007+0000 7f11dbc24700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f11d40898b0 0x7f11d4081170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:30.012 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.007+0000 7f11dbc24700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11d4089ce0 con 0x7f11d4089480 2019-12-19T22:08:30.013 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.007+0000 7f11dbc24700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11d408ae60 con 0x7f11d40898b0 2019-12-19T22:08:30.013 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.007+0000 7f11d99c0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f11d40898b0 0x7f11d4081170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:30.013 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.008+0000 7f11d99c0700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f11d40898b0 0x7f11d4081170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54010/0 (socket says 172.21.15.50:54010) 2019-12-19T22:08:30.013 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.008+0000 7f11d99c0700 1 -- 172.21.15.50:0/2938163114 learned_addr learned my addr 172.21.15.50:0/2938163114 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:30.013 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.008+0000 7f11da1c1700 1 --1- 172.21.15.50:0/2938163114 >> v1:172.21.15.50:6789/0 conn(0x7f11d4089480 0x7f11d408f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40138/0 (socket says 172.21.15.50:40138) 2019-12-19T22:08:30.013 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.008+0000 7f11d99c0700 1 -- 172.21.15.50:0/2938163114 >> v1:172.21.15.50:6789/0 conn(0x7f11d4089480 legacy=0x7f11d408f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:30.013 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.008+0000 7f11d99c0700 1 -- 172.21.15.50:0/2938163114 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d408edb0 con 0x7f11d40898b0 2019-12-19T22:08:30.014 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.008+0000 7f11d99c0700 1 --2- 172.21.15.50:0/2938163114 >> v2:172.21.15.50:3300/0 conn(0x7f11d40898b0 0x7f11d4081170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f11c4008790 tx=0x7f11c400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:30.014 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.008+0000 7f11d99c0700 1 --2- 172.21.15.50:0/2938163114 >> v2:172.21.15.50:3300/0 conn(0x7f11d40898b0 0x7f11d4081170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f11c4008790 tx=0x7f11c400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:30.014 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.008+0000 7f11d99c0700 1 --2- 172.21.15.50:0/2938163114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11d40898b0 0x7f11d4081170 secure :-1 s=READY pgs=279 cs=0 l=1 rx=0x7f11c4008790 tx=0x7f11c400fcb0).ready entity=mon.0 client_cookie=603d8eeed1f10767 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:30.014 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.008+0000 7f11d99c0700 1 --2- 172.21.15.50:0/2938163114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11d40898b0 0x7f11d4081170 secure :-1 s=THROTTLE_DONE pgs=279 cs=0 l=1 rx=0x7f11c4008790 tx=0x7f11c400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:30.014 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.008+0000 7f11d91bf700 1 -- 172.21.15.50:0/2938163114 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f11c4011330 con 0x7f11d40898b0 2019-12-19T22:08:30.015 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.008+0000 7f11d99c0700 1 --2- 172.21.15.50:0/2938163114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11d40898b0 0x7f11d4081170 secure :-1 s=THROTTLE_DONE pgs=279 cs=0 l=1 rx=0x7f11c4008790 tx=0x7f11c400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:30.015 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.008+0000 7f11d99c0700 1 --2- 172.21.15.50:0/2938163114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11d40898b0 0x7f11d4081170 secure :-1 s=THROTTLE_DONE pgs=279 cs=0 l=1 rx=0x7f11c4008790 tx=0x7f11c400fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:30.015 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.008+0000 7f11d91bf700 1 -- 172.21.15.50:0/2938163114 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c4011530 con 0x7f11d40898b0 2019-12-19T22:08:30.015 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.008+0000 7f11d91bf700 1 -- 172.21.15.50:0/2938163114 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f11c4011850 con 0x7f11d40898b0 2019-12-19T22:08:30.015 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.008+0000 7f11dbc24700 1 -- 172.21.15.50:0/2938163114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11d40898b0 msgr2=0x7f11d4081170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:30.015 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.008+0000 7f11dbc24700 1 --2- 172.21.15.50:0/2938163114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11d40898b0 0x7f11d4081170 secure :-1 s=READY pgs=279 cs=0 l=1 rx=0x7f11c4008790 tx=0x7f11c400fcb0).stop 2019-12-19T22:08:30.016 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.009+0000 7f11dbc24700 1 -- 172.21.15.50:0/2938163114 shutdown_connections 2019-12-19T22:08:30.016 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.009+0000 7f11dbc24700 1 --2- 172.21.15.50:0/2938163114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11d40898b0 0x7f11d4081170 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:30.016 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.009+0000 7f11dbc24700 1 -- 172.21.15.50:0/2938163114 shutdown_connections 2019-12-19T22:08:30.016 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.009+0000 7f11dbc24700 1 -- 172.21.15.50:0/2938163114 wait complete. 2019-12-19T22:08:30.016 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.009+0000 7f11dbc24700 1 -- 172.21.15.50:0/2938163114 >> 172.21.15.50:0/2938163114 conn(0x7f11d4067e70 msgr2=0x7f11d4094570 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:30.016 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.009+0000 7f11dbc24700 1 Processor -- start 2019-12-19T22:08:30.017 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.010+0000 7f11dbc24700 1 -- start start 2019-12-19T22:08:30.020 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.010+0000 7f11dbc24700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f11d4121910 0x7f11d4123d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:30.020 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.010+0000 7f11dbc24700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11d4077c50 con 0x7f11d411e6c0 2019-12-19T22:08:30.020 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.010+0000 7f11dbc24700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11d40769b0 con 0x7f11d4121910 2019-12-19T22:08:30.020 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.010+0000 7f11da1c1700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f11d411e6c0 0x7f11d411eaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40142/0 (socket says 172.21.15.50:40142) 2019-12-19T22:08:30.021 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.010+0000 7f11da1c1700 1 -- 172.21.15.50:0/1893866292 learned_addr learned my addr 172.21.15.50:0/1893866292 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:30.021 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.010+0000 7f11d99c0700 1 --2- 172.21.15.50:0/1893866292 >> v2:172.21.15.50:3300/0 conn(0x7f11d4121910 0x7f11d4123d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:30.021 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.010+0000 7f11caffd700 1 -- 172.21.15.50:0/1893866292 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2684619835 0 0) 0x7f11d4077c50 con 0x7f11d411e6c0 2019-12-19T22:08:30.021 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.010+0000 7f11caffd700 1 -- 172.21.15.50:0/1893866292 --> v1:172.21.15.50:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11bc0030b0 con 0x7f11d411e6c0 2019-12-19T22:08:30.021 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.010+0000 7f11d99c0700 1 -- 172.21.15.50:0/1893866292 >> v1:172.21.15.50:6789/0 conn(0x7f11d411e6c0 legacy=0x7f11d411eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:30.021 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.010+0000 7f11d99c0700 1 -- 172.21.15.50:0/1893866292 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d40775b0 con 0x7f11d4121910 2019-12-19T22:08:30.021 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.010+0000 7f11d99c0700 1 --2- 172.21.15.50:0/1893866292 >> v2:172.21.15.50:3300/0 conn(0x7f11d4121910 0x7f11d4123d50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f11c4008790 tx=0x7f11c400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:30.022 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.010+0000 7f11d99c0700 1 --2- 172.21.15.50:0/1893866292 >> v2:172.21.15.50:3300/0 conn(0x7f11d4121910 0x7f11d4123d50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f11c4008790 tx=0x7f11c400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:30.022 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.011+0000 7f11d99c0700 1 --2- 172.21.15.50:0/1893866292 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11d4121910 0x7f11d4123d50 secure :-1 s=READY pgs=281 cs=0 l=1 rx=0x7f11c4008790 tx=0x7f11c400f780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:30.022 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.011+0000 7f11d99c0700 1 --2- 172.21.15.50:0/1893866292 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11d4121910 0x7f11d4123d50 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7f11c4008790 tx=0x7f11c400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:30.022 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.011+0000 7f11caffd700 1 -- 172.21.15.50:0/1893866292 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f11c4007280 con 0x7f11d4121910 2019-12-19T22:08:30.022 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.011+0000 7f11d99c0700 1 --2- 172.21.15.50:0/1893866292 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11d4121910 0x7f11d4123d50 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7f11c4008790 tx=0x7f11c400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:30.022 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.011+0000 7f11d99c0700 1 --2- 172.21.15.50:0/1893866292 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11d4121910 0x7f11d4123d50 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7f11c4008790 tx=0x7f11c400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:30.022 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.011+0000 7f11caffd700 1 -- 172.21.15.50:0/1893866292 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c40115c0 con 0x7f11d4121910 2019-12-19T22:08:30.023 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.011+0000 7f11caffd700 1 -- 172.21.15.50:0/1893866292 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f11c40118e0 con 0x7f11d4121910 2019-12-19T22:08:30.023 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.011+0000 7f11dbc24700 1 -- 172.21.15.50:0/1893866292 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11d4078770 con 0x7f11d4121910 2019-12-19T22:08:30.024 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.011+0000 7f11dbc24700 1 -- 172.21.15.50:0/1893866292 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11d4077f50 con 0x7f11d4121910 2019-12-19T22:08:30.024 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.011+0000 7f11d99c0700 1 --2- 172.21.15.50:0/1893866292 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11d4121910 0x7f11d4123d50 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7f11c4008790 tx=0x7f11c400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:30.024 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.011+0000 7f11caffd700 1 -- 172.21.15.50:0/1893866292 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7f11c4005540 con 0x7f11d4121910 2019-12-19T22:08:30.024 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.011+0000 7f11d99c0700 1 --2- 172.21.15.50:0/1893866292 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11d4121910 0x7f11d4123d50 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7f11c4008790 tx=0x7f11c400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:30.024 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.011+0000 7f11caffd700 1 --2- 172.21.15.50:0/1893866292 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f11bc020070 0x7f11bc022580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:30.024 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.011+0000 7f11caffd700 1 -- 172.21.15.50:0/1893866292 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3786+0+0 (secure 0 0 0) 0x7f11c402aa10 con 0x7f11d4121910 2019-12-19T22:08:30.024 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.012+0000 7f11da1c1700 1 --2- 172.21.15.50:0/1893866292 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f11bc020070 0x7f11bc022580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:30.025 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.012+0000 7f11da1c1700 1 --2- 172.21.15.50:0/1893866292 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f11bc020070 0x7f11bc022580 crc :-1 s=READY pgs=68 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:30.025 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.012+0000 7f11dbc24700 1 -- 172.21.15.50:0/1893866292 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11d4056340 con 0x7f11d4121910 2019-12-19T22:08:30.025 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.015+0000 7f11d99c0700 1 --2- 172.21.15.50:0/1893866292 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11d4121910 0x7f11d4123d50 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x7f11c4008790 tx=0x7f11c400f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:30.025 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.015+0000 7f11caffd700 1 -- 172.21.15.50:0/1893866292 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7f11c4005d70 con 0x7f11d4121910 2019-12-19T22:08:30.156 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.154+0000 7f11dbc24700 1 -- 172.21.15.50:0/1893866292 --> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f11d408dcf0 con 0x7f11bc020070 2019-12-19T22:08:30.156 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.154+0000 7f11caffd700 1 -- 172.21.15.50:0/1893866292 <== mgr.4103 v2:172.21.15.50:6824/27190 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (crc 0 0 0) 0x7f11d408dcf0 con 0x7f11bc020070 2019-12-19T22:08:30.158 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.155+0000 7f11dbc24700 1 -- 172.21.15.50:0/1893866292 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f11bc020070 msgr2=0x7f11bc022580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:30.159 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.155+0000 7f11dbc24700 1 --2- 172.21.15.50:0/1893866292 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f11bc020070 0x7f11bc022580 crc :-1 s=READY pgs=68 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:30.159 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.155+0000 7f11dbc24700 1 -- 172.21.15.50:0/1893866292 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11d4121910 msgr2=0x7f11d4123d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:30.159 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.155+0000 7f11dbc24700 1 --2- 172.21.15.50:0/1893866292 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11d4121910 0x7f11d4123d50 secure :-1 s=READY pgs=281 cs=0 l=1 rx=0x7f11c4008790 tx=0x7f11c400f780).stop 2019-12-19T22:08:30.159 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.155+0000 7f11dbc24700 1 -- 172.21.15.50:0/1893866292 shutdown_connections 2019-12-19T22:08:30.160 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.155+0000 7f11dbc24700 1 --2- 172.21.15.50:0/1893866292 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f11bc020070 0x7f11bc022580 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:30.160 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.155+0000 7f11dbc24700 1 --2- 172.21.15.50:0/1893866292 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11d4121910 0x7f11d4123d50 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:30.160 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.155+0000 7f11dbc24700 1 -- 172.21.15.50:0/1893866292 shutdown_connections 2019-12-19T22:08:30.160 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.155+0000 7f11dbc24700 1 -- 172.21.15.50:0/1893866292 wait complete. 2019-12-19T22:08:30.161 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.155+0000 7f11dbc24700 1 -- 172.21.15.50:0/1893866292 >> 172.21.15.50:0/1893866292 conn(0x7f11d4091150 msgr2=0x7f11d407ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:30.161 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 2 to deep-scrub 2019-12-19T22:08:30.168 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2019-12-19T22:08:30.287 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.279+0000 7fb059ccb700 1 Processor -- start 2019-12-19T22:08:30.287 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.279+0000 7fb059ccb700 1 -- start start 2019-12-19T22:08:30.287 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.280+0000 7fb059ccb700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb0540898b0 0x7fb054081170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:30.287 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.280+0000 7fb059ccb700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb054089ce0 con 0x7fb054089480 2019-12-19T22:08:30.287 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.280+0000 7fb059ccb700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb05408ae60 con 0x7fb0540898b0 2019-12-19T22:08:30.288 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.280+0000 7fb04bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb0540898b0 0x7fb054081170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:30.288 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.280+0000 7fb04bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb0540898b0 0x7fb054081170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54020/0 (socket says 172.21.15.50:54020) 2019-12-19T22:08:30.288 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.280+0000 7fb04bfff700 1 -- 172.21.15.50:0/837719004 learned_addr learned my addr 172.21.15.50:0/837719004 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:30.288 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.280+0000 7fb053fff700 1 --1- 172.21.15.50:0/837719004 >> v1:172.21.15.50:6789/0 conn(0x7fb054089480 0x7fb05408f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40148/0 (socket says 172.21.15.50:40148) 2019-12-19T22:08:30.289 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.280+0000 7fb04bfff700 1 -- 172.21.15.50:0/837719004 >> v1:172.21.15.50:6789/0 conn(0x7fb054089480 legacy=0x7fb05408f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:30.289 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.280+0000 7fb04bfff700 1 -- 172.21.15.50:0/837719004 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb05408edb0 con 0x7fb0540898b0 2019-12-19T22:08:30.289 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.280+0000 7fb04bfff700 1 --2- 172.21.15.50:0/837719004 >> v2:172.21.15.50:3300/0 conn(0x7fb0540898b0 0x7fb054081170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb03c008790 tx=0x7fb03c00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:30.289 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.280+0000 7fb04bfff700 1 --2- 172.21.15.50:0/837719004 >> v2:172.21.15.50:3300/0 conn(0x7fb0540898b0 0x7fb054081170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb03c008790 tx=0x7fb03c00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:30.289 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.280+0000 7fb04bfff700 1 --2- 172.21.15.50:0/837719004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0540898b0 0x7fb054081170 secure :-1 s=READY pgs=283 cs=0 l=1 rx=0x7fb03c008790 tx=0x7fb03c00fcb0).ready entity=mon.0 client_cookie=39e0099d5faf1eb1 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:30.289 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.280+0000 7fb04bfff700 1 --2- 172.21.15.50:0/837719004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0540898b0 0x7fb054081170 secure :-1 s=THROTTLE_DONE pgs=283 cs=0 l=1 rx=0x7fb03c008790 tx=0x7fb03c00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:30.289 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.280+0000 7fb0537fe700 1 -- 172.21.15.50:0/837719004 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fb03c011330 con 0x7fb0540898b0 2019-12-19T22:08:30.290 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.280+0000 7fb04bfff700 1 --2- 172.21.15.50:0/837719004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0540898b0 0x7fb054081170 secure :-1 s=THROTTLE_DONE pgs=283 cs=0 l=1 rx=0x7fb03c008790 tx=0x7fb03c00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:30.290 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.280+0000 7fb04bfff700 1 --2- 172.21.15.50:0/837719004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0540898b0 0x7fb054081170 secure :-1 s=THROTTLE_DONE pgs=283 cs=0 l=1 rx=0x7fb03c008790 tx=0x7fb03c00fcb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:30.290 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.280+0000 7fb0537fe700 1 -- 172.21.15.50:0/837719004 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03c011530 con 0x7fb0540898b0 2019-12-19T22:08:30.290 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.280+0000 7fb0537fe700 1 -- 172.21.15.50:0/837719004 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fb03c011850 con 0x7fb0540898b0 2019-12-19T22:08:30.290 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.280+0000 7fb059ccb700 1 -- 172.21.15.50:0/837719004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0540898b0 msgr2=0x7fb054081170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:30.290 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.280+0000 7fb059ccb700 1 --2- 172.21.15.50:0/837719004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0540898b0 0x7fb054081170 secure :-1 s=READY pgs=283 cs=0 l=1 rx=0x7fb03c008790 tx=0x7fb03c00fcb0).stop 2019-12-19T22:08:30.290 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.281+0000 7fb059ccb700 1 -- 172.21.15.50:0/837719004 shutdown_connections 2019-12-19T22:08:30.291 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.281+0000 7fb059ccb700 1 --2- 172.21.15.50:0/837719004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0540898b0 0x7fb054081170 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:30.291 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.281+0000 7fb059ccb700 1 -- 172.21.15.50:0/837719004 shutdown_connections 2019-12-19T22:08:30.291 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.281+0000 7fb059ccb700 1 -- 172.21.15.50:0/837719004 wait complete. 2019-12-19T22:08:30.291 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.281+0000 7fb059ccb700 1 -- 172.21.15.50:0/837719004 >> 172.21.15.50:0/837719004 conn(0x7fb054067e70 msgr2=0x7fb054094570 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:30.291 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.282+0000 7fb059ccb700 1 Processor -- start 2019-12-19T22:08:30.291 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.282+0000 7fb059ccb700 1 -- start start 2019-12-19T22:08:30.291 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.282+0000 7fb059ccb700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb054121910 0x7fb054123d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:30.292 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.282+0000 7fb059ccb700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb054077c50 con 0x7fb05411e6c0 2019-12-19T22:08:30.292 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.282+0000 7fb059ccb700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0540769b0 con 0x7fb054121910 2019-12-19T22:08:30.292 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.282+0000 7fb04bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb054121910 0x7fb054123d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:30.292 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.282+0000 7fb053fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7fb05411e6c0 0x7fb05411eaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40150/0 (socket says 172.21.15.50:40150) 2019-12-19T22:08:30.292 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.283+0000 7fb04bfff700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7fb054121910 0x7fb054123d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54024/0 (socket says 172.21.15.50:54024) 2019-12-19T22:08:30.292 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.283+0000 7fb053fff700 1 -- 172.21.15.50:0/2862793982 learned_addr learned my addr 172.21.15.50:0/2862793982 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:30.292 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.283+0000 7fb04bfff700 1 -- 172.21.15.50:0/2862793982 >> v1:172.21.15.50:6789/0 conn(0x7fb05411e6c0 legacy=0x7fb05411eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:30.293 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.283+0000 7fb04bfff700 1 -- 172.21.15.50:0/2862793982 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0540775b0 con 0x7fb054121910 2019-12-19T22:08:30.293 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.283+0000 7fb0517fa700 1 -- 172.21.15.50:0/2862793982 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3810101509 0 0) 0x7fb054077c50 con 0x7fb05411e6c0 2019-12-19T22:08:30.293 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.283+0000 7fb04bfff700 1 --2- 172.21.15.50:0/2862793982 >> v2:172.21.15.50:3300/0 conn(0x7fb054121910 0x7fb054123d50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb03c008790 tx=0x7fb03c00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:30.293 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.283+0000 7fb04bfff700 1 --2- 172.21.15.50:0/2862793982 >> v2:172.21.15.50:3300/0 conn(0x7fb054121910 0x7fb054123d50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb03c008790 tx=0x7fb03c00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:30.293 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.283+0000 7fb04bfff700 1 --2- 172.21.15.50:0/2862793982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb054121910 0x7fb054123d50 secure :-1 s=READY pgs=285 cs=0 l=1 rx=0x7fb03c008790 tx=0x7fb03c00f780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:30.293 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.283+0000 7fb04bfff700 1 --2- 172.21.15.50:0/2862793982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb054121910 0x7fb054123d50 secure :-1 s=THROTTLE_DONE pgs=285 cs=0 l=1 rx=0x7fb03c008790 tx=0x7fb03c00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:30.293 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.283+0000 7fb0517fa700 1 -- 172.21.15.50:0/2862793982 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fb03c007280 con 0x7fb054121910 2019-12-19T22:08:30.294 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.283+0000 7fb04bfff700 1 --2- 172.21.15.50:0/2862793982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb054121910 0x7fb054123d50 secure :-1 s=THROTTLE_DONE pgs=285 cs=0 l=1 rx=0x7fb03c008790 tx=0x7fb03c00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:30.294 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.283+0000 7fb04bfff700 1 --2- 172.21.15.50:0/2862793982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb054121910 0x7fb054123d50 secure :-1 s=THROTTLE_DONE pgs=285 cs=0 l=1 rx=0x7fb03c008790 tx=0x7fb03c00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:30.294 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.283+0000 7fb0517fa700 1 -- 172.21.15.50:0/2862793982 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03c0115c0 con 0x7fb054121910 2019-12-19T22:08:30.294 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.283+0000 7fb059ccb700 1 -- 172.21.15.50:0/2862793982 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb054078770 con 0x7fb054121910 2019-12-19T22:08:30.294 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.283+0000 7fb0517fa700 1 -- 172.21.15.50:0/2862793982 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7fb03c0118e0 con 0x7fb054121910 2019-12-19T22:08:30.294 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.283+0000 7fb059ccb700 1 -- 172.21.15.50:0/2862793982 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb054077f50 con 0x7fb054121910 2019-12-19T22:08:30.294 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.283+0000 7fb04bfff700 1 --2- 172.21.15.50:0/2862793982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb054121910 0x7fb054123d50 secure :-1 s=THROTTLE_DONE pgs=285 cs=0 l=1 rx=0x7fb03c008790 tx=0x7fb03c00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:30.295 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.284+0000 7fb0517fa700 1 -- 172.21.15.50:0/2862793982 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7fb03c005540 con 0x7fb054121910 2019-12-19T22:08:30.295 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.284+0000 7fb04bfff700 1 --2- 172.21.15.50:0/2862793982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb054121910 0x7fb054123d50 secure :-1 s=THROTTLE_DONE pgs=285 cs=0 l=1 rx=0x7fb03c008790 tx=0x7fb03c00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:30.295 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.284+0000 7fb0517fa700 1 --2- 172.21.15.50:0/2862793982 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fb03801fa20 0x7fb038021f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:30.295 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.284+0000 7fb0517fa700 1 -- 172.21.15.50:0/2862793982 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3786+0+0 (secure 0 0 0) 0x7fb03c02aa20 con 0x7fb054121910 2019-12-19T22:08:30.295 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.284+0000 7fb053fff700 1 --2- 172.21.15.50:0/2862793982 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fb03801fa20 0x7fb038021f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:30.295 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.284+0000 7fb053fff700 1 --2- 172.21.15.50:0/2862793982 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fb03801fa20 0x7fb038021f30 crc :-1 s=READY pgs=69 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:30.295 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.284+0000 7fb059ccb700 1 -- 172.21.15.50:0/2862793982 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb054056340 con 0x7fb054121910 2019-12-19T22:08:30.296 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.287+0000 7fb04bfff700 1 --2- 172.21.15.50:0/2862793982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb054121910 0x7fb054123d50 secure :-1 s=THROTTLE_DONE pgs=285 cs=0 l=1 rx=0x7fb03c008790 tx=0x7fb03c00f780).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:30.310 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.287+0000 7fb0517fa700 1 -- 172.21.15.50:0/2862793982 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7fb03c005d70 con 0x7fb054121910 2019-12-19T22:08:30.422 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.420+0000 7fb059ccb700 1 -- 172.21.15.50:0/2862793982 --> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb05408dcf0 con 0x7fb03801fa20 2019-12-19T22:08:30.425 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.422+0000 7fb0517fa700 1 -- 172.21.15.50:0/2862793982 <== mgr.4103 v2:172.21.15.50:6824/27190 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+74186 (crc 0 0 0) 0x7fb05408dcf0 con 0x7fb03801fa20 2019-12-19T22:08:30.425 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:08:30.427 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.423+0000 7fb059ccb700 1 -- 172.21.15.50:0/2862793982 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fb03801fa20 msgr2=0x7fb038021f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:30.427 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.423+0000 7fb059ccb700 1 --2- 172.21.15.50:0/2862793982 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fb03801fa20 0x7fb038021f30 crc :-1 s=READY pgs=69 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:30.427 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.423+0000 7fb059ccb700 1 -- 172.21.15.50:0/2862793982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb054121910 msgr2=0x7fb054123d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:30.427 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.423+0000 7fb059ccb700 1 --2- 172.21.15.50:0/2862793982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb054121910 0x7fb054123d50 secure :-1 s=READY pgs=285 cs=0 l=1 rx=0x7fb03c008790 tx=0x7fb03c00f780).stop 2019-12-19T22:08:30.428 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.424+0000 7fb059ccb700 1 -- 172.21.15.50:0/2862793982 shutdown_connections 2019-12-19T22:08:30.428 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.424+0000 7fb059ccb700 1 --2- 172.21.15.50:0/2862793982 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7fb03801fa20 0x7fb038021f30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:30.428 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.424+0000 7fb059ccb700 1 --2- 172.21.15.50:0/2862793982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb054121910 0x7fb054123d50 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:30.429 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.424+0000 7fb059ccb700 1 -- 172.21.15.50:0/2862793982 shutdown_connections 2019-12-19T22:08:30.429 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.424+0000 7fb059ccb700 1 -- 172.21.15.50:0/2862793982 wait complete. 2019-12-19T22:08:30.429 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:30.424+0000 7fb059ccb700 1 -- 172.21.15.50:0/2862793982 >> 172.21.15.50:0/2862793982 conn(0x7fb054091150 msgr2=0x7fb05407ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:30.429 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2019-12-19T22:08:30.436 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2019-12-19T22:08:29.891059+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2706,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":56,"acting":56,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":56,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":3146440,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":3145728,"kb_avail":311426360,"statfs":{"total":322122547200,"available":318900592640,"internally_reserved":3221225472,"allocated":704512,"data_stored":245736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3221225472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":420,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001556"},"pg_stats":[{"pgid":"4.0","version":"0'0","reported_seq":"13","reported_epoch":"24","state":"active+clean","last_fresh":"2019-12-19T22:08:22.404531+0000","last_change":"2019-12-19T22:08:17.394356+0000","last_active":"2019-12-19T22:08:22.404531+0000","last_peered":"2019-12-19T22:08:22.404531+0000","last_clean":"2019-12-19T22:08:22.404531+0000","last_became_active":"2019-12-19T22:08:17.393620+0000","last_became_peered":"2019-12-19T22:08:17.393620+0000","last_unstale":"2019-12-19T22:08:22.404531+0000","last_undegraded":"2019-12-19T22:08:22.404531+0000","last_fullsized":"2019-12-19T22:08:22.404531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:16.385696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:16.385696+0000","last_clean_scrub_stamp":"2019-12-19T22:08:16.385696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2019-12-19T22:08:22.621814+0000","last_change":"2019-12-19T22:08:06.718253+0000","last_active":"2019-12-19T22:08:22.621814+0000","last_peered":"2019-12-19T22:08:22.621814+0000","last_clean":"2019-12-19T22:08:22.621814+0000","last_became_active":"2019-12-19T22:08:06.717951+0000","last_became_peered":"2019-12-19T22:08:06.717951+0000","last_unstale":"2019-12-19T22:08:22.621814+0000","last_undegraded":"2019-12-19T22:08:22.621814+0000","last_fullsized":"2019-12-19T22:08:22.621814+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_clean_scrub_stamp":"2019-12-19T22:08:06.374096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"19","reported_epoch":"24","state":"active+clean","last_fresh":"2019-12-19T22:08:22.621805+0000","last_change":"2019-12-19T22:08:03.376599+0000","last_active":"2019-12-19T22:08:22.621805+0000","last_peered":"2019-12-19T22:08:22.621805+0000","last_clean":"2019-12-19T22:08:22.621805+0000","last_became_active":"2019-12-19T22:08:03.376233+0000","last_became_peered":"2019-12-19T22:08:03.376233+0000","last_unstale":"2019-12-19T22:08:22.621805+0000","last_undegraded":"2019-12-19T22:08:22.621805+0000","last_fullsized":"2019-12-19T22:08:22.621805+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_clean_scrub_stamp":"2019-12-19T22:08:02.364860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"17'4","reported_seq":"20","reported_epoch":"24","state":"active+clean","last_fresh":"2019-12-19T22:08:23.377939+0000","last_change":"2019-12-19T22:08:06.383420+0000","last_active":"2019-12-19T22:08:23.377939+0000","last_peered":"2019-12-19T22:08:23.377939+0000","last_clean":"2019-12-19T22:08:23.377939+0000","last_became_active":"2019-12-19T22:08:06.382998+0000","last_became_peered":"2019-12-19T22:08:06.382998+0000","last_unstale":"2019-12-19T22:08:23.377939+0000","last_undegraded":"2019-12-19T22:08:23.377939+0000","last_fullsized":"2019-12-19T22:08:23.377939+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_clean_scrub_stamp":"2019-12-19T22:08:05.371035+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"13","reported_epoch":"24","state":"active+clean","last_fresh":"2019-12-19T22:08:22.621880+0000","last_change":"2019-12-19T22:08:17.394609+0000","last_active":"2019-12-19T22:08:22.621880+0000","last_peered":"2019-12-19T22:08:22.621880+0000","last_clean":"2019-12-19T22:08:22.621880+0000","last_became_active":"2019-12-19T22:08:17.394220+0000","last_became_peered":"2019-12-19T22:08:17.394220+0000","last_unstale":"2019-12-19T22:08:22.621880+0000","last_undegraded":"2019-12-19T22:08:22.621880+0000","last_fullsized":"2019-12-19T22:08:22.621880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:16.385696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:16.385696+0000","last_clean_scrub_stamp":"2019-12-19T22:08:16.385696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"15","reported_epoch":"24","state":"active+clean","last_fresh":"2019-12-19T22:08:22.404384+0000","last_change":"2019-12-19T22:08:06.715884+0000","last_active":"2019-12-19T22:08:22.404384+0000","last_peered":"2019-12-19T22:08:22.404384+0000","last_clean":"2019-12-19T22:08:22.404384+0000","last_became_active":"2019-12-19T22:08:06.715475+0000","last_became_peered":"2019-12-19T22:08:06.715475+0000","last_unstale":"2019-12-19T22:08:22.404384+0000","last_undegraded":"2019-12-19T22:08:22.404384+0000","last_fullsized":"2019-12-19T22:08:22.404384+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_clean_scrub_stamp":"2019-12-19T22:08:06.374096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"19","reported_epoch":"24","state":"active+clean","last_fresh":"2019-12-19T22:08:23.378368+0000","last_change":"2019-12-19T22:08:03.374278+0000","last_active":"2019-12-19T22:08:23.378368+0000","last_peered":"2019-12-19T22:08:23.378368+0000","last_clean":"2019-12-19T22:08:23.378368+0000","last_became_active":"2019-12-19T22:08:03.373911+0000","last_became_peered":"2019-12-19T22:08:03.373911+0000","last_unstale":"2019-12-19T22:08:23.378368+0000","last_undegraded":"2019-12-19T22:08:23.378368+0000","last_fullsized":"2019-12-19T22:08:23.378368+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_clean_scrub_stamp":"2019-12-19T22:08:02.364860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"17'7","reported_seq":"23","reported_epoch":"24","state":"active+clean","last_fresh":"2019-12-19T22:08:23.377916+0000","last_change":"2019-12-19T22:08:06.383498+0000","last_active":"2019-12-19T22:08:23.377916+0000","last_peered":"2019-12-19T22:08:23.377916+0000","last_clean":"2019-12-19T22:08:23.377916+0000","last_became_active":"2019-12-19T22:08:06.382983+0000","last_became_peered":"2019-12-19T22:08:06.382983+0000","last_unstale":"2019-12-19T22:08:23.377916+0000","last_undegraded":"2019-12-19T22:08:23.377916+0000","last_fullsized":"2019-12-19T22:08:23.377916+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_clean_scrub_stamp":"2019-12-19T22:08:05.371035+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2019-12-19T22:08:22.404775+0000","last_change":"2019-12-19T22:08:06.716855+0000","last_active":"2019-12-19T22:08:22.404775+0000","last_peered":"2019-12-19T22:08:22.404775+0000","last_clean":"2019-12-19T22:08:22.404775+0000","last_became_active":"2019-12-19T22:08:06.716480+0000","last_became_peered":"2019-12-19T22:08:06.716480+0000","last_unstale":"2019-12-19T22:08:22.404775+0000","last_undegraded":"2019-12-19T22:08:22.404775+0000","last_fullsized":"2019-12-19T22:08:22.404775+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_clean_scrub_stamp":"2019-12-19T22:08:06.374096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"19","reported_epoch":"24","state":"active+clean","last_fresh":"2019-12-19T22:08:23.378205+0000","last_change":"2019-12-19T22:08:03.373620+0000","last_active":"2019-12-19T22:08:23.378205+0000","last_peered":"2019-12-19T22:08:23.378205+0000","last_clean":"2019-12-19T22:08:23.378205+0000","last_became_active":"2019-12-19T22:08:03.373242+0000","last_became_peered":"2019-12-19T22:08:03.373242+0000","last_unstale":"2019-12-19T22:08:23.378205+0000","last_undegraded":"2019-12-19T22:08:23.378205+0000","last_fullsized":"2019-12-19T22:08:23.378205+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_clean_scrub_stamp":"2019-12-19T22:08:02.364860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'8","reported_seq":"25","reported_epoch":"24","state":"active+clean","last_fresh":"2019-12-19T22:08:22.621660+0000","last_change":"2019-12-19T22:08:06.384597+0000","last_active":"2019-12-19T22:08:22.621660+0000","last_peered":"2019-12-19T22:08:22.621660+0000","last_clean":"2019-12-19T22:08:22.621660+0000","last_became_active":"2019-12-19T22:08:06.383672+0000","last_became_peered":"2019-12-19T22:08:06.383672+0000","last_unstale":"2019-12-19T22:08:22.621660+0000","last_undegraded":"2019-12-19T22:08:22.621660+0000","last_fullsized":"2019-12-19T22:08:22.621660+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_clean_scrub_stamp":"2019-12-19T22:08:05.371035+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"15","reported_epoch":"24","state":"active+clean","last_fresh":"2019-12-19T22:08:23.377796+0000","last_change":"2019-12-19T22:08:06.717297+0000","last_active":"2019-12-19T22:08:23.377796+0000","last_peered":"2019-12-19T22:08:23.377796+0000","last_clean":"2019-12-19T22:08:23.377796+0000","last_became_active":"2019-12-19T22:08:06.717028+0000","last_became_peered":"2019-12-19T22:08:06.717028+0000","last_unstale":"2019-12-19T22:08:23.377796+0000","last_undegraded":"2019-12-19T22:08:23.377796+0000","last_fullsized":"2019-12-19T22:08:23.377796+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_clean_scrub_stamp":"2019-12-19T22:08:06.374096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"20","reported_epoch":"24","state":"active+clean","last_fresh":"2019-12-19T22:08:22.404930+0000","last_change":"2019-12-19T22:08:03.375294+0000","last_active":"2019-12-19T22:08:22.404930+0000","last_peered":"2019-12-19T22:08:22.404930+0000","last_clean":"2019-12-19T22:08:22.404930+0000","last_became_active":"2019-12-19T22:08:03.374963+0000","last_became_peered":"2019-12-19T22:08:03.374963+0000","last_unstale":"2019-12-19T22:08:22.404930+0000","last_undegraded":"2019-12-19T22:08:22.404930+0000","last_fullsized":"2019-12-19T22:08:22.404930+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_clean_scrub_stamp":"2019-12-19T22:08:02.364860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"17","reported_epoch":"24","state":"active+clean","last_fresh":"2019-12-19T22:08:22.622213+0000","last_change":"2019-12-19T22:08:06.384407+0000","last_active":"2019-12-19T22:08:22.622213+0000","last_peered":"2019-12-19T22:08:22.622213+0000","last_clean":"2019-12-19T22:08:22.622213+0000","last_became_active":"2019-12-19T22:08:06.383871+0000","last_became_peered":"2019-12-19T22:08:06.383871+0000","last_unstale":"2019-12-19T22:08:22.622213+0000","last_undegraded":"2019-12-19T22:08:22.622213+0000","last_fullsized":"2019-12-19T22:08:22.622213+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_clean_scrub_stamp":"2019-12-19T22:08:05.371035+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"15","reported_epoch":"24","state":"active+clean","last_fresh":"2019-12-19T22:08:23.377811+0000","last_change":"2019-12-19T22:08:06.717430+0000","last_active":"2019-12-19T22:08:23.377811+0000","last_peered":"2019-12-19T22:08:23.377811+0000","last_clean":"2019-12-19T22:08:23.377811+0000","last_became_active":"2019-12-19T22:08:06.717085+0000","last_became_peered":"2019-12-19T22:08:06.717085+0000","last_unstale":"2019-12-19T22:08:23.377811+0000","last_undegraded":"2019-12-19T22:08:23.377811+0000","last_fullsized":"2019-12-19T22:08:23.377811+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_clean_scrub_stamp":"2019-12-19T22:08:06.374096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"19","reported_epoch":"24","state":"active+clean","last_fresh":"2019-12-19T22:08:23.378514+0000","last_change":"2019-12-19T22:08:03.375817+0000","last_active":"2019-12-19T22:08:23.378514+0000","last_peered":"2019-12-19T22:08:23.378514+0000","last_clean":"2019-12-19T22:08:23.378514+0000","last_became_active":"2019-12-19T22:08:03.375549+0000","last_became_peered":"2019-12-19T22:08:03.375549+0000","last_unstale":"2019-12-19T22:08:23.378514+0000","last_undegraded":"2019-12-19T22:08:23.378514+0000","last_fullsized":"2019-12-19T22:08:23.378514+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_clean_scrub_stamp":"2019-12-19T22:08:02.364860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'5","reported_seq":"21","reported_epoch":"24","state":"active+clean","last_fresh":"2019-12-19T22:08:23.378044+0000","last_change":"2019-12-19T22:08:06.382991+0000","last_active":"2019-12-19T22:08:23.378044+0000","last_peered":"2019-12-19T22:08:23.378044+0000","last_clean":"2019-12-19T22:08:23.378044+0000","last_became_active":"2019-12-19T22:08:06.382299+0000","last_became_peered":"2019-12-19T22:08:06.382299+0000","last_unstale":"2019-12-19T22:08:23.378044+0000","last_undegraded":"2019-12-19T22:08:23.378044+0000","last_fullsized":"2019-12-19T22:08:23.378044+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_clean_scrub_stamp":"2019-12-19T22:08:05.371035+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"15","reported_epoch":"24","state":"active+clean","last_fresh":"2019-12-19T22:08:22.404713+0000","last_change":"2019-12-19T22:08:06.716759+0000","last_active":"2019-12-19T22:08:22.404713+0000","last_peered":"2019-12-19T22:08:22.404713+0000","last_clean":"2019-12-19T22:08:22.404713+0000","last_became_active":"2019-12-19T22:08:06.716445+0000","last_became_peered":"2019-12-19T22:08:06.716445+0000","last_unstale":"2019-12-19T22:08:22.404713+0000","last_undegraded":"2019-12-19T22:08:22.404713+0000","last_fullsized":"2019-12-19T22:08:22.404713+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_clean_scrub_stamp":"2019-12-19T22:08:06.374096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"19","reported_epoch":"24","state":"active+clean","last_fresh":"2019-12-19T22:08:22.622083+0000","last_change":"2019-12-19T22:08:03.374496+0000","last_active":"2019-12-19T22:08:22.622083+0000","last_peered":"2019-12-19T22:08:22.622083+0000","last_clean":"2019-12-19T22:08:22.622083+0000","last_became_active":"2019-12-19T22:08:03.373999+0000","last_became_peered":"2019-12-19T22:08:03.373999+0000","last_unstale":"2019-12-19T22:08:22.622083+0000","last_undegraded":"2019-12-19T22:08:22.622083+0000","last_fullsized":"2019-12-19T22:08:22.622083+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_clean_scrub_stamp":"2019-12-19T22:08:02.364860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"17'1","reported_seq":"17","reported_epoch":"24","state":"active+clean","last_fresh":"2019-12-19T22:08:22.403840+0000","last_change":"2019-12-19T22:08:06.383835+0000","last_active":"2019-12-19T22:08:22.403840+0000","last_peered":"2019-12-19T22:08:22.403840+0000","last_clean":"2019-12-19T22:08:22.403840+0000","last_became_active":"2019-12-19T22:08:06.383420+0000","last_became_peered":"2019-12-19T22:08:06.383420+0000","last_unstale":"2019-12-19T22:08:22.403840+0000","last_undegraded":"2019-12-19T22:08:22.403840+0000","last_fullsized":"2019-12-19T22:08:22.403840+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_clean_scrub_stamp":"2019-12-19T22:08:05.371035+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"13","reported_epoch":"24","state":"active+clean","last_fresh":"2019-12-19T22:08:22.404528+0000","last_change":"2019-12-19T22:08:17.394797+0000","last_active":"2019-12-19T22:08:22.404528+0000","last_peered":"2019-12-19T22:08:22.404528+0000","last_clean":"2019-12-19T22:08:22.404528+0000","last_became_active":"2019-12-19T22:08:17.394495+0000","last_became_peered":"2019-12-19T22:08:17.394495+0000","last_unstale":"2019-12-19T22:08:22.404528+0000","last_undegraded":"2019-12-19T22:08:22.404528+0000","last_fullsized":"2019-12-19T22:08:22.404528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:16.385696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:16.385696+0000","last_clean_scrub_stamp":"2019-12-19T22:08:16.385696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"15","reported_epoch":"24","state":"active+clean","last_fresh":"2019-12-19T22:08:23.378032+0000","last_change":"2019-12-19T22:08:06.717641+0000","last_active":"2019-12-19T22:08:23.378032+0000","last_peered":"2019-12-19T22:08:23.378032+0000","last_clean":"2019-12-19T22:08:23.378032+0000","last_became_active":"2019-12-19T22:08:06.717289+0000","last_became_peered":"2019-12-19T22:08:06.717289+0000","last_unstale":"2019-12-19T22:08:23.378032+0000","last_undegraded":"2019-12-19T22:08:23.378032+0000","last_fullsized":"2019-12-19T22:08:23.378032+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_clean_scrub_stamp":"2019-12-19T22:08:06.374096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"19","reported_epoch":"24","state":"active+clean","last_fresh":"2019-12-19T22:08:23.378329+0000","last_change":"2019-12-19T22:08:03.375588+0000","last_active":"2019-12-19T22:08:23.378329+0000","last_peered":"2019-12-19T22:08:23.378329+0000","last_clean":"2019-12-19T22:08:23.378329+0000","last_became_active":"2019-12-19T22:08:03.375236+0000","last_became_peered":"2019-12-19T22:08:03.375236+0000","last_unstale":"2019-12-19T22:08:23.378329+0000","last_undegraded":"2019-12-19T22:08:23.378329+0000","last_fullsized":"2019-12-19T22:08:23.378329+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_clean_scrub_stamp":"2019-12-19T22:08:02.364860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"17'6","reported_seq":"22","reported_epoch":"24","state":"active+clean","last_fresh":"2019-12-19T22:08:23.377916+0000","last_change":"2019-12-19T22:08:06.382924+0000","last_active":"2019-12-19T22:08:23.377916+0000","last_peered":"2019-12-19T22:08:23.377916+0000","last_clean":"2019-12-19T22:08:23.377916+0000","last_became_active":"2019-12-19T22:08:06.382181+0000","last_became_peered":"2019-12-19T22:08:06.382181+0000","last_unstale":"2019-12-19T22:08:23.377916+0000","last_undegraded":"2019-12-19T22:08:23.377916+0000","last_fullsized":"2019-12-19T22:08:23.377916+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_clean_scrub_stamp":"2019-12-19T22:08:05.371035+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2019-12-19T22:08:23.378245+0000","last_change":"2019-12-19T22:08:17.393884+0000","last_active":"2019-12-19T22:08:23.378245+0000","last_peered":"2019-12-19T22:08:23.378245+0000","last_clean":"2019-12-19T22:08:23.378245+0000","last_became_active":"2019-12-19T22:08:17.393478+0000","last_became_peered":"2019-12-19T22:08:17.393478+0000","last_unstale":"2019-12-19T22:08:23.378245+0000","last_undegraded":"2019-12-19T22:08:23.378245+0000","last_fullsized":"2019-12-19T22:08:23.378245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:16.385696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:16.385696+0000","last_clean_scrub_stamp":"2019-12-19T22:08:16.385696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2019-12-19T22:08:22.621900+0000","last_change":"2019-12-19T22:08:06.718506+0000","last_active":"2019-12-19T22:08:22.621900+0000","last_peered":"2019-12-19T22:08:22.621900+0000","last_clean":"2019-12-19T22:08:22.621900+0000","last_became_active":"2019-12-19T22:08:06.718242+0000","last_became_peered":"2019-12-19T22:08:06.718242+0000","last_unstale":"2019-12-19T22:08:22.621900+0000","last_undegraded":"2019-12-19T22:08:22.621900+0000","last_fullsized":"2019-12-19T22:08:22.621900+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_clean_scrub_stamp":"2019-12-19T22:08:06.374096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"19","reported_epoch":"24","state":"active+clean","last_fresh":"2019-12-19T22:08:23.378332+0000","last_change":"2019-12-19T22:08:03.373237+0000","last_active":"2019-12-19T22:08:23.378332+0000","last_peered":"2019-12-19T22:08:23.378332+0000","last_clean":"2019-12-19T22:08:23.378332+0000","last_became_active":"2019-12-19T22:08:03.372918+0000","last_became_peered":"2019-12-19T22:08:03.372918+0000","last_unstale":"2019-12-19T22:08:23.378332+0000","last_undegraded":"2019-12-19T22:08:23.378332+0000","last_fullsized":"2019-12-19T22:08:23.378332+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:02.364860+0000","last_clean_scrub_stamp":"2019-12-19T22:08:02.364860+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"25'10","reported_seq":"26","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:08:25.711668+0000","last_change":"2019-12-19T22:08:06.385018+0000","last_active":"2019-12-19T22:08:25.711668+0000","last_peered":"2019-12-19T22:08:25.711668+0000","last_clean":"2019-12-19T22:08:25.711668+0000","last_became_active":"2019-12-19T22:08:06.384716+0000","last_became_peered":"2019-12-19T22:08:06.384716+0000","last_unstale":"2019-12-19T22:08:25.711668+0000","last_undegraded":"2019-12-19T22:08:25.711668+0000","last_fullsized":"2019-12-19T22:08:25.711668+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_clean_scrub_stamp":"2019-12-19T22:08:05.371035+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1946,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":4,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":8,"acting":8,"num_store_stats":3},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":2706,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705672,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048824,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808776,"statfs":{"total":107374182400,"available":106300186624,"internally_reserved":1073741824,"allocated":245760,"data_stored":82814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.380}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.281}]}]},{"osd":2,"up_from":8,"seq":34359738377,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048796,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808804,"statfs":{"total":107374182400,"available":106300215296,"internally_reserved":1073741824,"allocated":217088,"data_stored":80142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.189}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.270}]}]},{"osd":0,"up_from":9,"seq":38654705673,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808780,"statfs":{"total":107374182400,"available":106300190720,"internally_reserved":1073741824,"allocated":241664,"data_stored":82780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.295}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.237}]}]}]}} 2019-12-19T22:08:30.452 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2019-12-19T22:08:16.385696+0000 time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=16, tm_wday=3, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=27, tm_wday=3, tm_yday=353, tm_isdst=0) 2019-12-19T22:08:30.452 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2019-12-19T22:08:06.374096+0000 time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=6, tm_wday=3, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=27, tm_wday=3, tm_yday=353, tm_isdst=0) 2019-12-19T22:08:30.452 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2019-12-19T22:08:02.364860+0000 time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=2, tm_wday=3, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=27, tm_wday=3, tm_yday=353, tm_isdst=0) 2019-12-19T22:08:30.453 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2019-12-19T22:08:05.371035+0000 time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=27, tm_wday=3, tm_yday=353, tm_isdst=0) 2019-12-19T22:08:30.453 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2019-12-19T22:08:16.385696+0000 time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=16, tm_wday=3, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=27, tm_wday=3, tm_yday=353, tm_isdst=0) 2019-12-19T22:08:30.453 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2019-12-19T22:08:06.374096+0000 time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=6, tm_wday=3, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=27, tm_wday=3, tm_yday=353, tm_isdst=0) 2019-12-19T22:08:30.453 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2019-12-19T22:08:02.364860+0000 time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=2, tm_wday=3, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=27, tm_wday=3, tm_yday=353, tm_isdst=0) 2019-12-19T22:08:30.453 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2019-12-19T22:08:05.371035+0000 time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=27, tm_wday=3, tm_yday=353, tm_isdst=0) 2019-12-19T22:08:30.454 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2019-12-19T22:08:06.374096+0000 time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=6, tm_wday=3, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=27, tm_wday=3, tm_yday=353, tm_isdst=0) 2019-12-19T22:08:30.454 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2019-12-19T22:08:02.364860+0000 time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=2, tm_wday=3, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=27, tm_wday=3, tm_yday=353, tm_isdst=0) 2019-12-19T22:08:30.454 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2019-12-19T22:08:05.371035+0000 time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=27, tm_wday=3, tm_yday=353, tm_isdst=0) 2019-12-19T22:08:30.454 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2019-12-19T22:08:06.374096+0000 time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=6, tm_wday=3, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=27, tm_wday=3, tm_yday=353, tm_isdst=0) 2019-12-19T22:08:30.454 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2019-12-19T22:08:02.364860+0000 time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=2, tm_wday=3, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=27, tm_wday=3, tm_yday=353, tm_isdst=0) 2019-12-19T22:08:30.454 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2019-12-19T22:08:05.371035+0000 time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=27, tm_wday=3, tm_yday=353, tm_isdst=0) 2019-12-19T22:08:30.456 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2019-12-19T22:08:06.374096+0000 time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=6, tm_wday=3, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=27, tm_wday=3, tm_yday=353, tm_isdst=0) 2019-12-19T22:08:30.456 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2019-12-19T22:08:02.364860+0000 time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=2, tm_wday=3, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=27, tm_wday=3, tm_yday=353, tm_isdst=0) 2019-12-19T22:08:30.456 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2019-12-19T22:08:05.371035+0000 time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=27, tm_wday=3, tm_yday=353, tm_isdst=0) 2019-12-19T22:08:30.457 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2019-12-19T22:08:06.374096+0000 time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=6, tm_wday=3, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=27, tm_wday=3, tm_yday=353, tm_isdst=0) 2019-12-19T22:08:30.457 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2019-12-19T22:08:02.364860+0000 time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=2, tm_wday=3, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=27, tm_wday=3, tm_yday=353, tm_isdst=0) 2019-12-19T22:08:30.457 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2019-12-19T22:08:05.371035+0000 time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=27, tm_wday=3, tm_yday=353, tm_isdst=0) 2019-12-19T22:08:30.457 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2019-12-19T22:08:16.385696+0000 time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=16, tm_wday=3, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=27, tm_wday=3, tm_yday=353, tm_isdst=0) 2019-12-19T22:08:30.457 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2019-12-19T22:08:06.374096+0000 time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=6, tm_wday=3, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=27, tm_wday=3, tm_yday=353, tm_isdst=0) 2019-12-19T22:08:30.458 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2019-12-19T22:08:02.364860+0000 time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=2, tm_wday=3, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=27, tm_wday=3, tm_yday=353, tm_isdst=0) 2019-12-19T22:08:30.458 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2019-12-19T22:08:05.371035+0000 time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=27, tm_wday=3, tm_yday=353, tm_isdst=0) 2019-12-19T22:08:30.458 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2019-12-19T22:08:16.385696+0000 time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=16, tm_wday=3, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=27, tm_wday=3, tm_yday=353, tm_isdst=0) 2019-12-19T22:08:30.458 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2019-12-19T22:08:06.374096+0000 time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=6, tm_wday=3, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=27, tm_wday=3, tm_yday=353, tm_isdst=0) 2019-12-19T22:08:30.459 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2019-12-19T22:08:02.364860+0000 time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=2, tm_wday=3, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=27, tm_wday=3, tm_yday=353, tm_isdst=0) 2019-12-19T22:08:30.459 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2019-12-19T22:08:05.371035+0000 time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=27, tm_wday=3, tm_yday=353, tm_isdst=0) 2019-12-19T22:08:30.459 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2019-12-19T22:08:50.469 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2019-12-19T22:08:50.597 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.592+0000 7f21ffc31700 1 Processor -- start 2019-12-19T22:08:50.598 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.592+0000 7f21ffc31700 1 -- start start 2019-12-19T22:08:50.598 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.593+0000 7f21ffc31700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f21f8089480 0x7f21f80898b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:08:50.598 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.593+0000 7f21ffc31700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f808edb0 con 0x7f21f808f3d0 2019-12-19T22:08:50.598 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.593+0000 7f21ffc31700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21f808ae60 con 0x7f21f8089480 2019-12-19T22:08:50.598 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.593+0000 7f21fe1ce700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f21f8089480 0x7f21f80898b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:50.598 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.593+0000 7f21fd9cd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f21f808f3d0 0x7f21f8081170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40156/0 (socket says 172.21.15.50:40156) 2019-12-19T22:08:50.598 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.593+0000 7f21fd9cd700 1 -- 172.21.15.50:0/3895838874 learned_addr learned my addr 172.21.15.50:0/3895838874 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:08:50.599 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.593+0000 7f21fe1ce700 1 -- 172.21.15.50:0/3895838874 >> v1:172.21.15.50:6789/0 conn(0x7f21f808f3d0 legacy=0x7f21f8081170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:50.599 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.593+0000 7f21fd1cc700 1 -- 172.21.15.50:0/3895838874 <== mon.0 v1:172.21.15.50:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 347710844 0 0) 0x7f21f808edb0 con 0x7f21f808f3d0 2019-12-19T22:08:50.599 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.593+0000 7f21fe1ce700 1 -- 172.21.15.50:0/3895838874 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f8081970 con 0x7f21f8089480 2019-12-19T22:08:50.599 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.593+0000 7f21fe1ce700 1 --2- 172.21.15.50:0/3895838874 >> v2:172.21.15.50:3300/0 conn(0x7f21f8089480 0x7f21f80898b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f21f4008790 tx=0x7f21f400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:50.599 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.593+0000 7f21fe1ce700 1 --2- 172.21.15.50:0/3895838874 >> v2:172.21.15.50:3300/0 conn(0x7f21f8089480 0x7f21f80898b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f21f4008790 tx=0x7f21f400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:50.599 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.593+0000 7f21fe1ce700 1 --2- 172.21.15.50:0/3895838874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21f8089480 0x7f21f80898b0 secure :-1 s=READY pgs=287 cs=0 l=1 rx=0x7f21f4008790 tx=0x7f21f400fbf0).ready entity=mon.0 client_cookie=3fd6a8c14c689137 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:50.599 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.594+0000 7f21fe1ce700 1 --2- 172.21.15.50:0/3895838874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21f8089480 0x7f21f80898b0 secure :-1 s=THROTTLE_DONE pgs=287 cs=0 l=1 rx=0x7f21f4008790 tx=0x7f21f400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:50.600 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.594+0000 7f21fd1cc700 1 -- 172.21.15.50:0/3895838874 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f21f4011270 con 0x7f21f8089480 2019-12-19T22:08:50.600 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.594+0000 7f21fe1ce700 1 --2- 172.21.15.50:0/3895838874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21f8089480 0x7f21f80898b0 secure :-1 s=THROTTLE_DONE pgs=287 cs=0 l=1 rx=0x7f21f4008790 tx=0x7f21f400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:50.600 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.594+0000 7f21fd1cc700 1 -- 172.21.15.50:0/3895838874 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f4011470 con 0x7f21f8089480 2019-12-19T22:08:50.600 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.594+0000 7f21fe1ce700 1 --2- 172.21.15.50:0/3895838874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21f8089480 0x7f21f80898b0 secure :-1 s=THROTTLE_DONE pgs=287 cs=0 l=1 rx=0x7f21f4008790 tx=0x7f21f400fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:50.600 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.594+0000 7f21fd1cc700 1 -- 172.21.15.50:0/3895838874 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f21f4011790 con 0x7f21f8089480 2019-12-19T22:08:50.600 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.594+0000 7f21ffc31700 1 -- 172.21.15.50:0/3895838874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21f8089480 msgr2=0x7f21f80898b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:50.601 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.594+0000 7f21ffc31700 1 --2- 172.21.15.50:0/3895838874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21f8089480 0x7f21f80898b0 secure :-1 s=READY pgs=287 cs=0 l=1 rx=0x7f21f4008790 tx=0x7f21f400fbf0).stop 2019-12-19T22:08:50.601 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.594+0000 7f21ffc31700 1 -- 172.21.15.50:0/3895838874 shutdown_connections 2019-12-19T22:08:50.601 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.594+0000 7f21ffc31700 1 --2- 172.21.15.50:0/3895838874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21f8089480 0x7f21f80898b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:50.601 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.594+0000 7f21ffc31700 1 -- 172.21.15.50:0/3895838874 shutdown_connections 2019-12-19T22:08:50.601 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.594+0000 7f21ffc31700 1 -- 172.21.15.50:0/3895838874 wait complete. 2019-12-19T22:08:50.601 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.594+0000 7f21ffc31700 1 -- 172.21.15.50:0/3895838874 >> 172.21.15.50:0/3895838874 conn(0x7f21f8067e70 msgr2=0x7f21f8094570 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:50.601 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.595+0000 7f21ffc31700 1 Processor -- start 2019-12-19T22:08:50.602 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.595+0000 7f21ffc31700 1 -- start start 2019-12-19T22:08:50.607 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.596+0000 7f21ffc31700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f21f80605a0 0x7f21f80609d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:50.608 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.596+0000 7f21ffc31700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f8061350 con 0x7f21f8060f20 2019-12-19T22:08:50.608 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.596+0000 7f21ffc31700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21f8063840 con 0x7f21f80605a0 2019-12-19T22:08:50.608 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.596+0000 7f21fe1ce700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f21f80605a0 0x7f21f80609d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:50.608 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.596+0000 7f21fe1ce700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f21f80605a0 0x7f21f80609d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54030/0 (socket says 172.21.15.50:54030) 2019-12-19T22:08:50.608 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.596+0000 7f21fe1ce700 1 -- 172.21.15.50:0/2785387035 learned_addr learned my addr 172.21.15.50:0/2785387035 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:08:50.609 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.596+0000 7f21fe1ce700 1 -- 172.21.15.50:0/2785387035 >> v1:172.21.15.50:6789/0 conn(0x7f21f8060f20 legacy=0x7f21f8079fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:50.609 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.596+0000 7f21fe1ce700 1 -- 172.21.15.50:0/2785387035 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f8063df0 con 0x7f21f80605a0 2019-12-19T22:08:50.609 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.596+0000 7f21fe1ce700 1 --2- 172.21.15.50:0/2785387035 >> v2:172.21.15.50:3300/0 conn(0x7f21f80605a0 0x7f21f80609d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f21f4008790 tx=0x7f21f400f530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:50.609 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.596+0000 7f21fe1ce700 1 --2- 172.21.15.50:0/2785387035 >> v2:172.21.15.50:3300/0 conn(0x7f21f80605a0 0x7f21f80609d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f21f4008790 tx=0x7f21f400f530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:50.609 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.596+0000 7f21fe1ce700 1 --2- 172.21.15.50:0/2785387035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21f80605a0 0x7f21f80609d0 secure :-1 s=READY pgs=289 cs=0 l=1 rx=0x7f21f4008790 tx=0x7f21f400f530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:50.609 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.596+0000 7f21fe1ce700 1 --2- 172.21.15.50:0/2785387035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21f80605a0 0x7f21f80609d0 secure :-1 s=THROTTLE_DONE pgs=289 cs=0 l=1 rx=0x7f21f4008790 tx=0x7f21f400f530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:50.609 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.596+0000 7f21fe1ce700 1 --2- 172.21.15.50:0/2785387035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21f80605a0 0x7f21f80609d0 secure :-1 s=THROTTLE_DONE pgs=289 cs=0 l=1 rx=0x7f21f4008790 tx=0x7f21f400f530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:50.610 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.596+0000 7f21eeffd700 1 -- 172.21.15.50:0/2785387035 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f21f4007280 con 0x7f21f80605a0 2019-12-19T22:08:50.610 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.596+0000 7f21fe1ce700 1 --2- 172.21.15.50:0/2785387035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21f80605a0 0x7f21f80609d0 secure :-1 s=THROTTLE_DONE pgs=289 cs=0 l=1 rx=0x7f21f4008790 tx=0x7f21f400f530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:50.610 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.596+0000 7f21eeffd700 1 -- 172.21.15.50:0/2785387035 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f4011480 con 0x7f21f80605a0 2019-12-19T22:08:50.610 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.596+0000 7f21ffc31700 1 -- 172.21.15.50:0/2785387035 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21f8062070 con 0x7f21f80605a0 2019-12-19T22:08:50.610 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.596+0000 7f21eeffd700 1 -- 172.21.15.50:0/2785387035 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f21f4005540 con 0x7f21f80605a0 2019-12-19T22:08:50.610 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.596+0000 7f21ffc31700 1 -- 172.21.15.50:0/2785387035 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21f8063490 con 0x7f21f80605a0 2019-12-19T22:08:50.610 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.597+0000 7f21fe1ce700 1 --2- 172.21.15.50:0/2785387035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21f80605a0 0x7f21f80609d0 secure :-1 s=THROTTLE_DONE pgs=289 cs=0 l=1 rx=0x7f21f4008790 tx=0x7f21f400f530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:50.611 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.597+0000 7f21eeffd700 1 -- 172.21.15.50:0/2785387035 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7f21f4005850 con 0x7f21f80605a0 2019-12-19T22:08:50.611 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.597+0000 7f21fe1ce700 1 --2- 172.21.15.50:0/2785387035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21f80605a0 0x7f21f80609d0 secure :-1 s=THROTTLE_DONE pgs=289 cs=0 l=1 rx=0x7f21f4008790 tx=0x7f21f400f530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:50.611 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.597+0000 7f21eeffd700 1 --2- 172.21.15.50:0/2785387035 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f21e001fa80 0x7f21e0021f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:08:50.611 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.597+0000 7f21eeffd700 1 -- 172.21.15.50:0/2785387035 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3786+0+0 (secure 0 0 0) 0x7f21f402acc0 con 0x7f21f80605a0 2019-12-19T22:08:50.611 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.597+0000 7f21fd9cd700 1 --2- 172.21.15.50:0/2785387035 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f21e001fa80 0x7f21e0021f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:08:50.611 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.597+0000 7f21fd9cd700 1 --2- 172.21.15.50:0/2785387035 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f21e001fa80 0x7f21e0021f90 crc :-1 s=READY pgs=70 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:08:50.611 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.598+0000 7f21ffc31700 1 -- 172.21.15.50:0/2785387035 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21f8056340 con 0x7f21f80605a0 2019-12-19T22:08:50.612 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.601+0000 7f21fe1ce700 1 --2- 172.21.15.50:0/2785387035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21f80605a0 0x7f21f80609d0 secure :-1 s=THROTTLE_DONE pgs=289 cs=0 l=1 rx=0x7f21f4008790 tx=0x7f21f400f530).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:08:50.612 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.601+0000 7f21eeffd700 1 -- 172.21.15.50:0/2785387035 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7f21f400d400 con 0x7f21f80605a0 2019-12-19T22:08:50.737 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.734+0000 7f21ffc31700 1 -- 172.21.15.50:0/2785387035 --> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f21f807e790 con 0x7f21e001fa80 2019-12-19T22:08:50.741 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.737+0000 7f21eeffd700 1 -- 172.21.15.50:0/2785387035 <== mgr.4103 v2:172.21.15.50:6824/27190 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+74218 (crc 0 0 0) 0x7f21f807e790 con 0x7f21e001fa80 2019-12-19T22:08:50.741 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.738+0000 7f21ffc31700 1 -- 172.21.15.50:0/2785387035 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f21e001fa80 msgr2=0x7f21e0021f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:50.742 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.738+0000 7f21ffc31700 1 --2- 172.21.15.50:0/2785387035 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f21e001fa80 0x7f21e0021f90 crc :-1 s=READY pgs=70 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:50.742 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.738+0000 7f21ffc31700 1 -- 172.21.15.50:0/2785387035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21f80605a0 msgr2=0x7f21f80609d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:08:50.742 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.738+0000 7f21ffc31700 1 --2- 172.21.15.50:0/2785387035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21f80605a0 0x7f21f80609d0 secure :-1 s=READY pgs=289 cs=0 l=1 rx=0x7f21f4008790 tx=0x7f21f400f530).stop 2019-12-19T22:08:50.742 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.738+0000 7f21ffc31700 1 -- 172.21.15.50:0/2785387035 shutdown_connections 2019-12-19T22:08:50.742 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.738+0000 7f21ffc31700 1 --2- 172.21.15.50:0/2785387035 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f21e001fa80 0x7f21e0021f90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:50.743 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.738+0000 7f21ffc31700 1 --2- 172.21.15.50:0/2785387035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21f80605a0 0x7f21f80609d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:08:50.743 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.738+0000 7f21ffc31700 1 -- 172.21.15.50:0/2785387035 shutdown_connections 2019-12-19T22:08:50.743 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.738+0000 7f21ffc31700 1 -- 172.21.15.50:0/2785387035 wait complete. 2019-12-19T22:08:50.743 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:08:50.738+0000 7f21ffc31700 1 -- 172.21.15.50:0/2785387035 >> 172.21.15.50:0/2785387035 conn(0x7f21f8081c40 msgr2=0x7f21f808b880 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:08:50.743 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2019-12-19T22:08:50.744 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:08:50.750 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":48,"stamp":"2019-12-19T22:08:49.895539+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2706,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4620,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":56,"acting":56,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":56,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":3146440,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":3145728,"kb_avail":311426360,"statfs":{"total":322122547200,"available":318900592640,"internally_reserved":3221225472,"allocated":704512,"data_stored":245736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3221225472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4620,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002578"},"pg_stats":[{"pgid":"4.0","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:08:42.355739+0000","last_change":"2019-12-19T22:08:42.355804+0000","last_active":"2019-12-19T22:08:42.355739+0000","last_peered":"2019-12-19T22:08:42.355739+0000","last_clean":"2019-12-19T22:08:42.355739+0000","last_became_active":"2019-12-19T22:08:17.393620+0000","last_became_peered":"2019-12-19T22:08:17.393620+0000","last_unstale":"2019-12-19T22:08:42.355739+0000","last_undegraded":"2019-12-19T22:08:42.355739+0000","last_fullsized":"2019-12-19T22:08:42.355739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:42.355733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:42.355733+0000","last_clean_scrub_stamp":"2019-12-19T22:08:42.355733+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2019-12-19T22:08:22.621814+0000","last_change":"2019-12-19T22:08:06.718253+0000","last_active":"2019-12-19T22:08:22.621814+0000","last_peered":"2019-12-19T22:08:22.621814+0000","last_clean":"2019-12-19T22:08:22.621814+0000","last_became_active":"2019-12-19T22:08:06.717951+0000","last_became_peered":"2019-12-19T22:08:06.717951+0000","last_unstale":"2019-12-19T22:08:22.621814+0000","last_undegraded":"2019-12-19T22:08:22.621814+0000","last_fullsized":"2019-12-19T22:08:22.621814+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_clean_scrub_stamp":"2019-12-19T22:08:06.374096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"22","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:08:34.283594+0000","last_change":"2019-12-19T22:08:34.283658+0000","last_active":"2019-12-19T22:08:34.283594+0000","last_peered":"2019-12-19T22:08:34.283594+0000","last_clean":"2019-12-19T22:08:34.283594+0000","last_became_active":"2019-12-19T22:08:03.376233+0000","last_became_peered":"2019-12-19T22:08:03.376233+0000","last_unstale":"2019-12-19T22:08:34.283594+0000","last_undegraded":"2019-12-19T22:08:34.283594+0000","last_fullsized":"2019-12-19T22:08:34.283594+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:34.283589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:34.283589+0000","last_clean_scrub_stamp":"2019-12-19T22:08:34.283589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"17'4","reported_seq":"20","reported_epoch":"24","state":"active+clean","last_fresh":"2019-12-19T22:08:23.377939+0000","last_change":"2019-12-19T22:08:06.383420+0000","last_active":"2019-12-19T22:08:23.377939+0000","last_peered":"2019-12-19T22:08:23.377939+0000","last_clean":"2019-12-19T22:08:23.377939+0000","last_became_active":"2019-12-19T22:08:06.382998+0000","last_became_peered":"2019-12-19T22:08:06.382998+0000","last_unstale":"2019-12-19T22:08:23.377939+0000","last_undegraded":"2019-12-19T22:08:23.377939+0000","last_fullsized":"2019-12-19T22:08:23.377939+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_clean_scrub_stamp":"2019-12-19T22:08:05.371035+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"13","reported_epoch":"24","state":"active+clean","last_fresh":"2019-12-19T22:08:22.621880+0000","last_change":"2019-12-19T22:08:17.394609+0000","last_active":"2019-12-19T22:08:22.621880+0000","last_peered":"2019-12-19T22:08:22.621880+0000","last_clean":"2019-12-19T22:08:22.621880+0000","last_became_active":"2019-12-19T22:08:17.394220+0000","last_became_peered":"2019-12-19T22:08:17.394220+0000","last_unstale":"2019-12-19T22:08:22.621880+0000","last_undegraded":"2019-12-19T22:08:22.621880+0000","last_fullsized":"2019-12-19T22:08:22.621880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:16.385696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:16.385696+0000","last_clean_scrub_stamp":"2019-12-19T22:08:16.385696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"18","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:08:41.328038+0000","last_change":"2019-12-19T22:08:41.328087+0000","last_active":"2019-12-19T22:08:41.328038+0000","last_peered":"2019-12-19T22:08:41.328038+0000","last_clean":"2019-12-19T22:08:41.328038+0000","last_became_active":"2019-12-19T22:08:06.715475+0000","last_became_peered":"2019-12-19T22:08:06.715475+0000","last_unstale":"2019-12-19T22:08:41.328038+0000","last_undegraded":"2019-12-19T22:08:41.328038+0000","last_fullsized":"2019-12-19T22:08:41.328038+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:41.328032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:41.328032+0000","last_clean_scrub_stamp":"2019-12-19T22:08:41.328032+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"22","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:08:36.381482+0000","last_change":"2019-12-19T22:08:36.381540+0000","last_active":"2019-12-19T22:08:36.381482+0000","last_peered":"2019-12-19T22:08:36.381482+0000","last_clean":"2019-12-19T22:08:36.381482+0000","last_became_active":"2019-12-19T22:08:03.373911+0000","last_became_peered":"2019-12-19T22:08:03.373911+0000","last_unstale":"2019-12-19T22:08:36.381482+0000","last_undegraded":"2019-12-19T22:08:36.381482+0000","last_fullsized":"2019-12-19T22:08:36.381482+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:36.381476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:36.381476+0000","last_clean_scrub_stamp":"2019-12-19T22:08:36.381476+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"17'7","reported_seq":"23","reported_epoch":"24","state":"active+clean","last_fresh":"2019-12-19T22:08:23.377916+0000","last_change":"2019-12-19T22:08:06.383498+0000","last_active":"2019-12-19T22:08:23.377916+0000","last_peered":"2019-12-19T22:08:23.377916+0000","last_clean":"2019-12-19T22:08:23.377916+0000","last_became_active":"2019-12-19T22:08:06.382983+0000","last_became_peered":"2019-12-19T22:08:06.382983+0000","last_unstale":"2019-12-19T22:08:23.377916+0000","last_undegraded":"2019-12-19T22:08:23.377916+0000","last_fullsized":"2019-12-19T22:08:23.377916+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:05.371035+0000","last_clean_scrub_stamp":"2019-12-19T22:08:05.371035+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"19","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:08:36.273678+0000","last_change":"2019-12-19T22:08:36.273732+0000","last_active":"2019-12-19T22:08:36.273678+0000","last_peered":"2019-12-19T22:08:36.273678+0000","last_clean":"2019-12-19T22:08:36.273678+0000","last_became_active":"2019-12-19T22:08:06.716480+0000","last_became_peered":"2019-12-19T22:08:06.716480+0000","last_unstale":"2019-12-19T22:08:36.273678+0000","last_undegraded":"2019-12-19T22:08:36.273678+0000","last_fullsized":"2019-12-19T22:08:36.273678+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:36.273672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:36.273672+0000","last_clean_scrub_stamp":"2019-12-19T22:08:36.273672+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"22","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:08:33.424724+0000","last_change":"2019-12-19T22:08:33.424781+0000","last_active":"2019-12-19T22:08:33.424724+0000","last_peered":"2019-12-19T22:08:33.424724+0000","last_clean":"2019-12-19T22:08:33.424724+0000","last_became_active":"2019-12-19T22:08:03.373242+0000","last_became_peered":"2019-12-19T22:08:03.373242+0000","last_unstale":"2019-12-19T22:08:33.424724+0000","last_undegraded":"2019-12-19T22:08:33.424724+0000","last_fullsized":"2019-12-19T22:08:33.424724+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:33.424718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:33.424718+0000","last_clean_scrub_stamp":"2019-12-19T22:08:33.424718+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'8","reported_seq":"28","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:08:35.294802+0000","last_change":"2019-12-19T22:08:35.294857+0000","last_active":"2019-12-19T22:08:35.294802+0000","last_peered":"2019-12-19T22:08:35.294802+0000","last_clean":"2019-12-19T22:08:35.294802+0000","last_became_active":"2019-12-19T22:08:06.383672+0000","last_became_peered":"2019-12-19T22:08:06.383672+0000","last_unstale":"2019-12-19T22:08:35.294802+0000","last_undegraded":"2019-12-19T22:08:35.294802+0000","last_fullsized":"2019-12-19T22:08:35.294802+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"17'8","last_scrub_stamp":"2019-12-19T22:08:35.294795+0000","last_deep_scrub":"17'8","last_deep_scrub_stamp":"2019-12-19T22:08:35.294795+0000","last_clean_scrub_stamp":"2019-12-19T22:08:35.294795+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"15","reported_epoch":"24","state":"active+clean","last_fresh":"2019-12-19T22:08:23.377796+0000","last_change":"2019-12-19T22:08:06.717297+0000","last_active":"2019-12-19T22:08:23.377796+0000","last_peered":"2019-12-19T22:08:23.377796+0000","last_clean":"2019-12-19T22:08:23.377796+0000","last_became_active":"2019-12-19T22:08:06.717028+0000","last_became_peered":"2019-12-19T22:08:06.717028+0000","last_unstale":"2019-12-19T22:08:23.377796+0000","last_undegraded":"2019-12-19T22:08:23.377796+0000","last_fullsized":"2019-12-19T22:08:23.377796+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_clean_scrub_stamp":"2019-12-19T22:08:06.374096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"23","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:08:31.161556+0000","last_change":"2019-12-19T22:08:31.161609+0000","last_active":"2019-12-19T22:08:31.161556+0000","last_peered":"2019-12-19T22:08:31.161556+0000","last_clean":"2019-12-19T22:08:31.161556+0000","last_became_active":"2019-12-19T22:08:03.374963+0000","last_became_peered":"2019-12-19T22:08:03.374963+0000","last_unstale":"2019-12-19T22:08:31.161556+0000","last_undegraded":"2019-12-19T22:08:31.161556+0000","last_fullsized":"2019-12-19T22:08:31.161556+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:31.161552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:31.161552+0000","last_clean_scrub_stamp":"2019-12-19T22:08:31.161552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"20","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:08:38.311092+0000","last_change":"2019-12-19T22:08:38.311172+0000","last_active":"2019-12-19T22:08:38.311092+0000","last_peered":"2019-12-19T22:08:38.311092+0000","last_clean":"2019-12-19T22:08:38.311092+0000","last_became_active":"2019-12-19T22:08:06.383871+0000","last_became_peered":"2019-12-19T22:08:06.383871+0000","last_unstale":"2019-12-19T22:08:38.311092+0000","last_undegraded":"2019-12-19T22:08:38.311092+0000","last_fullsized":"2019-12-19T22:08:38.311092+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:38.311082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:38.311082+0000","last_clean_scrub_stamp":"2019-12-19T22:08:38.311082+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"15","reported_epoch":"24","state":"active+clean","last_fresh":"2019-12-19T22:08:23.377811+0000","last_change":"2019-12-19T22:08:06.717430+0000","last_active":"2019-12-19T22:08:23.377811+0000","last_peered":"2019-12-19T22:08:23.377811+0000","last_clean":"2019-12-19T22:08:23.377811+0000","last_became_active":"2019-12-19T22:08:06.717085+0000","last_became_peered":"2019-12-19T22:08:06.717085+0000","last_unstale":"2019-12-19T22:08:23.377811+0000","last_undegraded":"2019-12-19T22:08:23.377811+0000","last_fullsized":"2019-12-19T22:08:23.377811+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_clean_scrub_stamp":"2019-12-19T22:08:06.374096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"22","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:08:31.407582+0000","last_change":"2019-12-19T22:08:31.407634+0000","last_active":"2019-12-19T22:08:31.407582+0000","last_peered":"2019-12-19T22:08:31.407582+0000","last_clean":"2019-12-19T22:08:31.407582+0000","last_became_active":"2019-12-19T22:08:03.375549+0000","last_became_peered":"2019-12-19T22:08:03.375549+0000","last_unstale":"2019-12-19T22:08:31.407582+0000","last_undegraded":"2019-12-19T22:08:31.407582+0000","last_fullsized":"2019-12-19T22:08:31.407582+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:31.407576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:31.407576+0000","last_clean_scrub_stamp":"2019-12-19T22:08:31.407576+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"25'8","reported_seq":"27","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:08:40.372587+0000","last_change":"2019-12-19T22:08:40.372651+0000","last_active":"2019-12-19T22:08:40.372587+0000","last_peered":"2019-12-19T22:08:40.372587+0000","last_clean":"2019-12-19T22:08:40.372587+0000","last_became_active":"2019-12-19T22:08:06.382299+0000","last_became_peered":"2019-12-19T22:08:06.382299+0000","last_unstale":"2019-12-19T22:08:40.372587+0000","last_undegraded":"2019-12-19T22:08:40.372587+0000","last_fullsized":"2019-12-19T22:08:40.372587+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8","last_scrub_stamp":"2019-12-19T22:08:40.372576+0000","last_deep_scrub":"25'8","last_deep_scrub_stamp":"2019-12-19T22:08:40.372576+0000","last_clean_scrub_stamp":"2019-12-19T22:08:40.372576+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4620,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"18","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:08:40.357124+0000","last_change":"2019-12-19T22:08:40.357188+0000","last_active":"2019-12-19T22:08:40.357124+0000","last_peered":"2019-12-19T22:08:40.357124+0000","last_clean":"2019-12-19T22:08:40.357124+0000","last_became_active":"2019-12-19T22:08:06.716445+0000","last_became_peered":"2019-12-19T22:08:06.716445+0000","last_unstale":"2019-12-19T22:08:40.357124+0000","last_undegraded":"2019-12-19T22:08:40.357124+0000","last_fullsized":"2019-12-19T22:08:40.357124+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:40.357119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:40.357119+0000","last_clean_scrub_stamp":"2019-12-19T22:08:40.357119+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"22","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:08:32.276690+0000","last_change":"2019-12-19T22:08:32.276765+0000","last_active":"2019-12-19T22:08:32.276690+0000","last_peered":"2019-12-19T22:08:32.276690+0000","last_clean":"2019-12-19T22:08:32.276690+0000","last_became_active":"2019-12-19T22:08:03.373999+0000","last_became_peered":"2019-12-19T22:08:03.373999+0000","last_unstale":"2019-12-19T22:08:32.276690+0000","last_undegraded":"2019-12-19T22:08:32.276690+0000","last_fullsized":"2019-12-19T22:08:32.276690+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:32.276682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:32.276682+0000","last_clean_scrub_stamp":"2019-12-19T22:08:32.276682+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"17'1","reported_seq":"20","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:08:34.234456+0000","last_change":"2019-12-19T22:08:34.234511+0000","last_active":"2019-12-19T22:08:34.234456+0000","last_peered":"2019-12-19T22:08:34.234456+0000","last_clean":"2019-12-19T22:08:34.234456+0000","last_became_active":"2019-12-19T22:08:06.383420+0000","last_became_peered":"2019-12-19T22:08:06.383420+0000","last_unstale":"2019-12-19T22:08:34.234456+0000","last_undegraded":"2019-12-19T22:08:34.234456+0000","last_fullsized":"2019-12-19T22:08:34.234456+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"17'1","last_scrub_stamp":"2019-12-19T22:08:34.234450+0000","last_deep_scrub":"17'1","last_deep_scrub_stamp":"2019-12-19T22:08:34.234450+0000","last_clean_scrub_stamp":"2019-12-19T22:08:34.234450+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:08:44.270940+0000","last_change":"2019-12-19T22:08:44.270991+0000","last_active":"2019-12-19T22:08:44.270940+0000","last_peered":"2019-12-19T22:08:44.270940+0000","last_clean":"2019-12-19T22:08:44.270940+0000","last_became_active":"2019-12-19T22:08:17.394495+0000","last_became_peered":"2019-12-19T22:08:17.394495+0000","last_unstale":"2019-12-19T22:08:44.270940+0000","last_undegraded":"2019-12-19T22:08:44.270940+0000","last_fullsized":"2019-12-19T22:08:44.270940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:44.270934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:44.270934+0000","last_clean_scrub_stamp":"2019-12-19T22:08:44.270934+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"15","reported_epoch":"24","state":"active+clean","last_fresh":"2019-12-19T22:08:23.378032+0000","last_change":"2019-12-19T22:08:06.717641+0000","last_active":"2019-12-19T22:08:23.378032+0000","last_peered":"2019-12-19T22:08:23.378032+0000","last_clean":"2019-12-19T22:08:23.378032+0000","last_became_active":"2019-12-19T22:08:06.717289+0000","last_became_peered":"2019-12-19T22:08:06.717289+0000","last_unstale":"2019-12-19T22:08:23.378032+0000","last_undegraded":"2019-12-19T22:08:23.378032+0000","last_fullsized":"2019-12-19T22:08:23.378032+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:06.374096+0000","last_clean_scrub_stamp":"2019-12-19T22:08:06.374096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"22","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:08:37.333198+0000","last_change":"2019-12-19T22:08:37.333245+0000","last_active":"2019-12-19T22:08:37.333198+0000","last_peered":"2019-12-19T22:08:37.333198+0000","last_clean":"2019-12-19T22:08:37.333198+0000","last_became_active":"2019-12-19T22:08:03.375236+0000","last_became_peered":"2019-12-19T22:08:03.375236+0000","last_unstale":"2019-12-19T22:08:37.333198+0000","last_undegraded":"2019-12-19T22:08:37.333198+0000","last_fullsized":"2019-12-19T22:08:37.333198+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:37.333192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:37.333192+0000","last_clean_scrub_stamp":"2019-12-19T22:08:37.333192+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"25'10","reported_seq":"29","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:08:46.385978+0000","last_change":"2019-12-19T22:08:46.386027+0000","last_active":"2019-12-19T22:08:46.385978+0000","last_peered":"2019-12-19T22:08:46.385978+0000","last_clean":"2019-12-19T22:08:46.385978+0000","last_became_active":"2019-12-19T22:08:06.382181+0000","last_became_peered":"2019-12-19T22:08:06.382181+0000","last_unstale":"2019-12-19T22:08:46.385978+0000","last_undegraded":"2019-12-19T22:08:46.385978+0000","last_fullsized":"2019-12-19T22:08:46.385978+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'10","last_scrub_stamp":"2019-12-19T22:08:46.385972+0000","last_deep_scrub":"25'10","last_deep_scrub_stamp":"2019-12-19T22:08:46.385972+0000","last_clean_scrub_stamp":"2019-12-19T22:08:46.385972+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2019-12-19T22:08:23.378245+0000","last_change":"2019-12-19T22:08:17.393884+0000","last_active":"2019-12-19T22:08:23.378245+0000","last_peered":"2019-12-19T22:08:23.378245+0000","last_clean":"2019-12-19T22:08:23.378245+0000","last_became_active":"2019-12-19T22:08:17.393478+0000","last_became_peered":"2019-12-19T22:08:17.393478+0000","last_unstale":"2019-12-19T22:08:23.378245+0000","last_undegraded":"2019-12-19T22:08:23.378245+0000","last_fullsized":"2019-12-19T22:08:23.378245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:16.385696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:16.385696+0000","last_clean_scrub_stamp":"2019-12-19T22:08:16.385696+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"19","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:08:43.389610+0000","last_change":"2019-12-19T22:08:43.389684+0000","last_active":"2019-12-19T22:08:43.389610+0000","last_peered":"2019-12-19T22:08:43.389610+0000","last_clean":"2019-12-19T22:08:43.389610+0000","last_became_active":"2019-12-19T22:08:06.718242+0000","last_became_peered":"2019-12-19T22:08:06.718242+0000","last_unstale":"2019-12-19T22:08:43.389610+0000","last_undegraded":"2019-12-19T22:08:43.389610+0000","last_fullsized":"2019-12-19T22:08:43.389610+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:43.389601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:43.389601+0000","last_clean_scrub_stamp":"2019-12-19T22:08:43.389601+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"22","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:08:38.328287+0000","last_change":"2019-12-19T22:08:38.328350+0000","last_active":"2019-12-19T22:08:38.328287+0000","last_peered":"2019-12-19T22:08:38.328287+0000","last_clean":"2019-12-19T22:08:38.328287+0000","last_became_active":"2019-12-19T22:08:03.372918+0000","last_became_peered":"2019-12-19T22:08:03.372918+0000","last_unstale":"2019-12-19T22:08:38.328287+0000","last_undegraded":"2019-12-19T22:08:38.328287+0000","last_fullsized":"2019-12-19T22:08:38.328287+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:38.328281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:38.328281+0000","last_clean_scrub_stamp":"2019-12-19T22:08:38.328281+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"25'13","reported_seq":"32","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:08:45.351089+0000","last_change":"2019-12-19T22:08:45.351155+0000","last_active":"2019-12-19T22:08:45.351089+0000","last_peered":"2019-12-19T22:08:45.351089+0000","last_clean":"2019-12-19T22:08:45.351089+0000","last_became_active":"2019-12-19T22:08:06.384716+0000","last_became_peered":"2019-12-19T22:08:06.384716+0000","last_unstale":"2019-12-19T22:08:45.351089+0000","last_undegraded":"2019-12-19T22:08:45.351089+0000","last_fullsized":"2019-12-19T22:08:45.351089+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'13","last_scrub_stamp":"2019-12-19T22:08:45.351079+0000","last_deep_scrub":"25'13","last_deep_scrub_stamp":"2019-12-19T22:08:45.351079+0000","last_clean_scrub_stamp":"2019-12-19T22:08:45.351079+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1946,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":4,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":8,"acting":8,"num_store_stats":3},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":2706,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4620,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705676,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048824,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808776,"statfs":{"total":107374182400,"available":106300186624,"internally_reserved":1073741824,"allocated":245760,"data_stored":82814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.244}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.269}]}]},{"osd":2,"up_from":8,"seq":34359738381,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048796,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808804,"statfs":{"total":107374182400,"available":106300215296,"internally_reserved":1073741824,"allocated":217088,"data_stored":80142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.458}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.432}]}]},{"osd":0,"up_from":9,"seq":38654705677,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808780,"statfs":{"total":107374182400,"available":106300190720,"internally_reserved":1073741824,"allocated":241664,"data_stored":82780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.346}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.296}]}]}]}} 2019-12-19T22:08:50.754 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2019-12-19T22:08:06.374096+0000 time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=6, tm_wday=3, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=27, tm_wday=3, tm_yday=353, tm_isdst=0) 2019-12-19T22:08:50.754 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2019-12-19T22:08:05.371035+0000 time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=27, tm_wday=3, tm_yday=353, tm_isdst=0) 2019-12-19T22:08:50.754 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2019-12-19T22:08:16.385696+0000 time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=16, tm_wday=3, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=27, tm_wday=3, tm_yday=353, tm_isdst=0) 2019-12-19T22:08:50.754 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2019-12-19T22:08:05.371035+0000 time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=5, tm_wday=3, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=27, tm_wday=3, tm_yday=353, tm_isdst=0) 2019-12-19T22:08:50.754 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2019-12-19T22:08:06.374096+0000 time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=6, tm_wday=3, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=27, tm_wday=3, tm_yday=353, tm_isdst=0) 2019-12-19T22:08:50.755 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2019-12-19T22:08:06.374096+0000 time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=6, tm_wday=3, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=27, tm_wday=3, tm_yday=353, tm_isdst=0) 2019-12-19T22:08:50.755 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2019-12-19T22:08:06.374096+0000 time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=6, tm_wday=3, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=27, tm_wday=3, tm_yday=353, tm_isdst=0) 2019-12-19T22:08:50.755 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2019-12-19T22:08:16.385696+0000 time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=16, tm_wday=3, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2019, tm_mon=12, tm_mday=19, tm_hour=22, tm_min=8, tm_sec=27, tm_wday=3, tm_yday=353, tm_isdst=0) 2019-12-19T22:08:50.755 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2019-12-19T22:09:10.756 INFO:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2019-12-19T22:09:10.898 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.889+0000 7ff0655de700 1 Processor -- start 2019-12-19T22:09:10.898 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.889+0000 7ff0655de700 1 -- start start 2019-12-19T22:09:10.898 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.889+0000 7ff0655de700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff060089480 0x7ff0600898b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:09:10.898 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.889+0000 7ff0655de700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff06008edb0 con 0x7ff06008f3d0 2019-12-19T22:09:10.898 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.889+0000 7ff0655de700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff06008ae60 con 0x7ff060089480 2019-12-19T22:09:10.898 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.890+0000 7ff05f7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff060089480 0x7ff0600898b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:09:10.899 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.890+0000 7ff05effd700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7ff06008f3d0 0x7ff060081170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40164/0 (socket says 172.21.15.50:40164) 2019-12-19T22:09:10.899 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.890+0000 7ff05effd700 1 -- 172.21.15.50:0/1544896983 learned_addr learned my addr 172.21.15.50:0/1544896983 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:09:10.899 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.890+0000 7ff05f7fe700 1 -- 172.21.15.50:0/1544896983 >> v1:172.21.15.50:6789/0 conn(0x7ff06008f3d0 legacy=0x7ff060081170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:09:10.899 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.890+0000 7ff05f7fe700 1 -- 172.21.15.50:0/1544896983 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff060081970 con 0x7ff060089480 2019-12-19T22:09:10.899 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.890+0000 7ff05f7fe700 1 --2- 172.21.15.50:0/1544896983 >> v2:172.21.15.50:3300/0 conn(0x7ff060089480 0x7ff0600898b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff058008b10 tx=0x7ff05800ff70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:09:10.899 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.890+0000 7ff05f7fe700 1 --2- 172.21.15.50:0/1544896983 >> v2:172.21.15.50:3300/0 conn(0x7ff060089480 0x7ff0600898b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff058008b10 tx=0x7ff05800ff70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:09:10.899 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.890+0000 7ff05f7fe700 1 --2- 172.21.15.50:0/1544896983 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff060089480 0x7ff0600898b0 secure :-1 s=READY pgs=291 cs=0 l=1 rx=0x7ff058008b10 tx=0x7ff05800ff70).ready entity=mon.0 client_cookie=94cee27161afed7e server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:09:10.900 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.891+0000 7ff05f7fe700 1 --2- 172.21.15.50:0/1544896983 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff060089480 0x7ff0600898b0 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7ff058008b10 tx=0x7ff05800ff70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:09:10.900 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.891+0000 7ff05e7fc700 1 -- 172.21.15.50:0/1544896983 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7ff058011850 con 0x7ff060089480 2019-12-19T22:09:10.900 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.891+0000 7ff05f7fe700 1 --2- 172.21.15.50:0/1544896983 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff060089480 0x7ff0600898b0 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7ff058008b10 tx=0x7ff05800ff70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:09:10.900 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.891+0000 7ff05f7fe700 1 --2- 172.21.15.50:0/1544896983 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff060089480 0x7ff0600898b0 secure :-1 s=THROTTLE_DONE pgs=291 cs=0 l=1 rx=0x7ff058008b10 tx=0x7ff05800ff70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:09:10.900 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.891+0000 7ff05e7fc700 1 -- 172.21.15.50:0/1544896983 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff058011a50 con 0x7ff060089480 2019-12-19T22:09:10.900 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.891+0000 7ff05e7fc700 1 -- 172.21.15.50:0/1544896983 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7ff058011df0 con 0x7ff060089480 2019-12-19T22:09:10.900 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.891+0000 7ff0655de700 1 -- 172.21.15.50:0/1544896983 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff060089480 msgr2=0x7ff0600898b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:09:10.901 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.891+0000 7ff0655de700 1 --2- 172.21.15.50:0/1544896983 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff060089480 0x7ff0600898b0 secure :-1 s=READY pgs=291 cs=0 l=1 rx=0x7ff058008b10 tx=0x7ff05800ff70).stop 2019-12-19T22:09:10.901 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.891+0000 7ff0655de700 1 -- 172.21.15.50:0/1544896983 shutdown_connections 2019-12-19T22:09:10.901 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.891+0000 7ff0655de700 1 --2- 172.21.15.50:0/1544896983 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff060089480 0x7ff0600898b0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:09:10.901 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.891+0000 7ff0655de700 1 -- 172.21.15.50:0/1544896983 shutdown_connections 2019-12-19T22:09:10.901 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.891+0000 7ff0655de700 1 -- 172.21.15.50:0/1544896983 wait complete. 2019-12-19T22:09:10.901 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.891+0000 7ff0655de700 1 -- 172.21.15.50:0/1544896983 >> 172.21.15.50:0/1544896983 conn(0x7ff060067e70 msgr2=0x7ff060094570 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:09:10.902 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.892+0000 7ff0655de700 1 Processor -- start 2019-12-19T22:09:10.902 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.892+0000 7ff0655de700 1 -- start start 2019-12-19T22:09:10.902 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.893+0000 7ff0655de700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff060084c30 0x7ff06011d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:09:10.903 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.893+0000 7ff0655de700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff060083af0 con 0x7ff06011de10 2019-12-19T22:09:10.903 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.893+0000 7ff0655de700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff06007e140 con 0x7ff060084c30 2019-12-19T22:09:10.903 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.893+0000 7ff05f7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff060084c30 0x7ff06011d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:09:10.903 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.893+0000 7ff05f7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7ff060084c30 0x7ff06011d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54040/0 (socket says 172.21.15.50:54040) 2019-12-19T22:09:10.903 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.893+0000 7ff05f7fe700 1 -- 172.21.15.50:0/259852498 learned_addr learned my addr 172.21.15.50:0/259852498 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:09:10.903 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.893+0000 7ff05f7fe700 1 -- 172.21.15.50:0/259852498 >> v1:172.21.15.50:6789/0 conn(0x7ff06011de10 legacy=0x7ff060082200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:09:10.903 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.893+0000 7ff05f7fe700 1 -- 172.21.15.50:0/259852498 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff060083720 con 0x7ff060084c30 2019-12-19T22:09:10.904 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.893+0000 7ff05f7fe700 1 --2- 172.21.15.50:0/259852498 >> v2:172.21.15.50:3300/0 conn(0x7ff060084c30 0x7ff06011d8c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff058008b10 tx=0x7ff058008a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:09:10.904 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.893+0000 7ff05f7fe700 1 --2- 172.21.15.50:0/259852498 >> v2:172.21.15.50:3300/0 conn(0x7ff060084c30 0x7ff06011d8c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff058008b10 tx=0x7ff058008a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:09:10.904 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.893+0000 7ff05f7fe700 1 --2- 172.21.15.50:0/259852498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff060084c30 0x7ff06011d8c0 secure :-1 s=READY pgs=293 cs=0 l=1 rx=0x7ff058008b10 tx=0x7ff058008a10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:09:10.904 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.894+0000 7ff05f7fe700 1 --2- 172.21.15.50:0/259852498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff060084c30 0x7ff06011d8c0 secure :-1 s=THROTTLE_DONE pgs=293 cs=0 l=1 rx=0x7ff058008b10 tx=0x7ff058008a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:09:10.904 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.894+0000 7ff05f7fe700 1 --2- 172.21.15.50:0/259852498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff060084c30 0x7ff06011d8c0 secure :-1 s=THROTTLE_DONE pgs=293 cs=0 l=1 rx=0x7ff058008b10 tx=0x7ff058008a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:09:10.904 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.894+0000 7ff047fff700 1 -- 172.21.15.50:0/259852498 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7ff0580058c0 con 0x7ff060084c30 2019-12-19T22:09:10.904 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.894+0000 7ff05f7fe700 1 --2- 172.21.15.50:0/259852498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff060084c30 0x7ff06011d8c0 secure :-1 s=THROTTLE_DONE pgs=293 cs=0 l=1 rx=0x7ff058008b10 tx=0x7ff058008a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:09:10.905 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.894+0000 7ff047fff700 1 -- 172.21.15.50:0/259852498 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff05800f9f0 con 0x7ff060084c30 2019-12-19T22:09:10.905 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.894+0000 7ff0655de700 1 -- 172.21.15.50:0/259852498 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0600846e0 con 0x7ff060084c30 2019-12-19T22:09:10.905 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.894+0000 7ff047fff700 1 -- 172.21.15.50:0/259852498 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7ff058005bf0 con 0x7ff060084c30 2019-12-19T22:09:10.905 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.894+0000 7ff0655de700 1 -- 172.21.15.50:0/259852498 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff06011e240 con 0x7ff060084c30 2019-12-19T22:09:10.905 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.894+0000 7ff05f7fe700 1 --2- 172.21.15.50:0/259852498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff060084c30 0x7ff06011d8c0 secure :-1 s=THROTTLE_DONE pgs=293 cs=0 l=1 rx=0x7ff058008b10 tx=0x7ff058008a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:09:10.905 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.894+0000 7ff047fff700 1 -- 172.21.15.50:0/259852498 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7ff058007180 con 0x7ff060084c30 2019-12-19T22:09:10.905 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.894+0000 7ff05f7fe700 1 --2- 172.21.15.50:0/259852498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff060084c30 0x7ff06011d8c0 secure :-1 s=THROTTLE_DONE pgs=293 cs=0 l=1 rx=0x7ff058008b10 tx=0x7ff058008a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:09:10.906 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.894+0000 7ff047fff700 1 --2- 172.21.15.50:0/259852498 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7ff040021c10 0x7ff040024120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:09:10.906 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.894+0000 7ff047fff700 1 -- 172.21.15.50:0/259852498 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3786+0+0 (secure 0 0 0) 0x7ff05802a970 con 0x7ff060084c30 2019-12-19T22:09:10.906 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.895+0000 7ff05effd700 1 --2- 172.21.15.50:0/259852498 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7ff040021c10 0x7ff040024120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:09:10.906 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.895+0000 7ff05effd700 1 --2- 172.21.15.50:0/259852498 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7ff040021c10 0x7ff040024120 crc :-1 s=READY pgs=71 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:09:10.906 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.895+0000 7ff0655de700 1 -- 172.21.15.50:0/259852498 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff060056340 con 0x7ff060084c30 2019-12-19T22:09:10.907 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.898+0000 7ff05f7fe700 1 --2- 172.21.15.50:0/259852498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff060084c30 0x7ff06011d8c0 secure :-1 s=THROTTLE_DONE pgs=293 cs=0 l=1 rx=0x7ff058008b10 tx=0x7ff058008a10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:09:10.907 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:10.898+0000 7ff047fff700 1 -- 172.21.15.50:0/259852498 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+114303 (secure 0 0 0) 0x7ff05800a160 con 0x7ff060084c30 2019-12-19T22:09:11.034 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.031+0000 7ff0655de700 1 -- 172.21.15.50:0/259852498 --> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff06007d970 con 0x7ff040021c10 2019-12-19T22:09:11.037 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.033+0000 7ff047fff700 1 -- 172.21.15.50:0/259852498 <== mgr.4103 v2:172.21.15.50:6824/27190 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+75321 (crc 0 0 0) 0x7ff06007d970 con 0x7ff040021c10 2019-12-19T22:09:11.037 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:09:11.038 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.035+0000 7ff0655de700 1 -- 172.21.15.50:0/259852498 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7ff040021c10 msgr2=0x7ff040024120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:09:11.038 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.035+0000 7ff0655de700 1 --2- 172.21.15.50:0/259852498 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7ff040021c10 0x7ff040024120 crc :-1 s=READY pgs=71 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:09:11.038 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.035+0000 7ff0655de700 1 -- 172.21.15.50:0/259852498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff060084c30 msgr2=0x7ff06011d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:09:11.039 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.035+0000 7ff0655de700 1 --2- 172.21.15.50:0/259852498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff060084c30 0x7ff06011d8c0 secure :-1 s=READY pgs=293 cs=0 l=1 rx=0x7ff058008b10 tx=0x7ff058008a10).stop 2019-12-19T22:09:11.039 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.035+0000 7ff0655de700 1 -- 172.21.15.50:0/259852498 shutdown_connections 2019-12-19T22:09:11.039 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.035+0000 7ff0655de700 1 --2- 172.21.15.50:0/259852498 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7ff040021c10 0x7ff040024120 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:09:11.039 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.035+0000 7ff0655de700 1 --2- 172.21.15.50:0/259852498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff060084c30 0x7ff06011d8c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:09:11.039 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.035+0000 7ff0655de700 1 -- 172.21.15.50:0/259852498 shutdown_connections 2019-12-19T22:09:11.039 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.035+0000 7ff0655de700 1 -- 172.21.15.50:0/259852498 wait complete. 2019-12-19T22:09:11.039 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.035+0000 7ff0655de700 1 -- 172.21.15.50:0/259852498 >> 172.21.15.50:0/259852498 conn(0x7ff060081c40 msgr2=0x7ff06007f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:09:11.040 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2019-12-19T22:09:11.049 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2019-12-19T22:09:09.899628+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2706,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4620,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":57,"ondisk_log_size":57,"up":56,"acting":56,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":56,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":3146440,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":3145728,"kb_avail":311426360,"statfs":{"total":322122547200,"available":318900592640,"internally_reserved":3221225472,"allocated":704512,"data_stored":245736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3221225472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002581"},"pg_stats":[{"pgid":"4.0","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:08:42.355739+0000","last_change":"2019-12-19T22:08:42.355804+0000","last_active":"2019-12-19T22:08:42.355739+0000","last_peered":"2019-12-19T22:08:42.355739+0000","last_clean":"2019-12-19T22:08:42.355739+0000","last_became_active":"2019-12-19T22:08:17.393620+0000","last_became_peered":"2019-12-19T22:08:17.393620+0000","last_unstale":"2019-12-19T22:08:42.355739+0000","last_undegraded":"2019-12-19T22:08:42.355739+0000","last_fullsized":"2019-12-19T22:08:42.355739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:42.355733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:42.355733+0000","last_clean_scrub_stamp":"2019-12-19T22:08:42.355733+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":"19","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:08:48.445619+0000","last_change":"2019-12-19T22:08:48.445686+0000","last_active":"2019-12-19T22:08:48.445619+0000","last_peered":"2019-12-19T22:08:48.445619+0000","last_clean":"2019-12-19T22:08:48.445619+0000","last_became_active":"2019-12-19T22:08:06.717951+0000","last_became_peered":"2019-12-19T22:08:06.717951+0000","last_unstale":"2019-12-19T22:08:48.445619+0000","last_undegraded":"2019-12-19T22:08:48.445619+0000","last_fullsized":"2019-12-19T22:08:48.445619+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:48.445613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:48.445613+0000","last_clean_scrub_stamp":"2019-12-19T22:08:48.445613+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"22","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:08:34.283594+0000","last_change":"2019-12-19T22:08:34.283658+0000","last_active":"2019-12-19T22:08:34.283594+0000","last_peered":"2019-12-19T22:08:34.283594+0000","last_clean":"2019-12-19T22:08:34.283594+0000","last_became_active":"2019-12-19T22:08:03.376233+0000","last_became_peered":"2019-12-19T22:08:03.376233+0000","last_unstale":"2019-12-19T22:08:34.283594+0000","last_undegraded":"2019-12-19T22:08:34.283594+0000","last_fullsized":"2019-12-19T22:08:34.283594+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:34.283589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:34.283589+0000","last_clean_scrub_stamp":"2019-12-19T22:08:34.283589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"25'6","reported_seq":"25","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:08:50.402548+0000","last_change":"2019-12-19T22:08:50.402592+0000","last_active":"2019-12-19T22:08:50.402548+0000","last_peered":"2019-12-19T22:08:50.402548+0000","last_clean":"2019-12-19T22:08:50.402548+0000","last_became_active":"2019-12-19T22:08:06.382998+0000","last_became_peered":"2019-12-19T22:08:06.382998+0000","last_unstale":"2019-12-19T22:08:50.402548+0000","last_undegraded":"2019-12-19T22:08:50.402548+0000","last_fullsized":"2019-12-19T22:08:50.402548+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6","last_scrub_stamp":"2019-12-19T22:08:50.402543+0000","last_deep_scrub":"25'6","last_deep_scrub_stamp":"2019-12-19T22:08:50.402543+0000","last_clean_scrub_stamp":"2019-12-19T22:08:50.402543+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:08:51.439963+0000","last_change":"2019-12-19T22:08:51.440026+0000","last_active":"2019-12-19T22:08:51.439963+0000","last_peered":"2019-12-19T22:08:51.439963+0000","last_clean":"2019-12-19T22:08:51.439963+0000","last_became_active":"2019-12-19T22:08:17.394220+0000","last_became_peered":"2019-12-19T22:08:17.394220+0000","last_unstale":"2019-12-19T22:08:51.439963+0000","last_undegraded":"2019-12-19T22:08:51.439963+0000","last_fullsized":"2019-12-19T22:08:51.439963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:51.439956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:51.439956+0000","last_clean_scrub_stamp":"2019-12-19T22:08:51.439956+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"18","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:08:41.328038+0000","last_change":"2019-12-19T22:08:41.328087+0000","last_active":"2019-12-19T22:08:41.328038+0000","last_peered":"2019-12-19T22:08:41.328038+0000","last_clean":"2019-12-19T22:08:41.328038+0000","last_became_active":"2019-12-19T22:08:06.715475+0000","last_became_peered":"2019-12-19T22:08:06.715475+0000","last_unstale":"2019-12-19T22:08:41.328038+0000","last_undegraded":"2019-12-19T22:08:41.328038+0000","last_fullsized":"2019-12-19T22:08:41.328038+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:41.328032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:41.328032+0000","last_clean_scrub_stamp":"2019-12-19T22:08:41.328032+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"22","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:08:36.381482+0000","last_change":"2019-12-19T22:08:36.381540+0000","last_active":"2019-12-19T22:08:36.381482+0000","last_peered":"2019-12-19T22:08:36.381482+0000","last_clean":"2019-12-19T22:08:36.381482+0000","last_became_active":"2019-12-19T22:08:03.373911+0000","last_became_peered":"2019-12-19T22:08:03.373911+0000","last_unstale":"2019-12-19T22:08:36.381482+0000","last_undegraded":"2019-12-19T22:08:36.381482+0000","last_fullsized":"2019-12-19T22:08:36.381482+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:36.381476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:36.381476+0000","last_clean_scrub_stamp":"2019-12-19T22:08:36.381476+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"25'11","reported_seq":"30","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:08:51.451645+0000","last_change":"2019-12-19T22:08:51.451691+0000","last_active":"2019-12-19T22:08:51.451645+0000","last_peered":"2019-12-19T22:08:51.451645+0000","last_clean":"2019-12-19T22:08:51.451645+0000","last_became_active":"2019-12-19T22:08:06.382983+0000","last_became_peered":"2019-12-19T22:08:06.382983+0000","last_unstale":"2019-12-19T22:08:51.451645+0000","last_undegraded":"2019-12-19T22:08:51.451645+0000","last_fullsized":"2019-12-19T22:08:51.451645+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'11","last_scrub_stamp":"2019-12-19T22:08:51.451638+0000","last_deep_scrub":"25'11","last_deep_scrub_stamp":"2019-12-19T22:08:51.451638+0000","last_clean_scrub_stamp":"2019-12-19T22:08:51.451638+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"19","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:08:36.273678+0000","last_change":"2019-12-19T22:08:36.273732+0000","last_active":"2019-12-19T22:08:36.273678+0000","last_peered":"2019-12-19T22:08:36.273678+0000","last_clean":"2019-12-19T22:08:36.273678+0000","last_became_active":"2019-12-19T22:08:06.716480+0000","last_became_peered":"2019-12-19T22:08:06.716480+0000","last_unstale":"2019-12-19T22:08:36.273678+0000","last_undegraded":"2019-12-19T22:08:36.273678+0000","last_fullsized":"2019-12-19T22:08:36.273678+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:36.273672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:36.273672+0000","last_clean_scrub_stamp":"2019-12-19T22:08:36.273672+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"22","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:08:33.424724+0000","last_change":"2019-12-19T22:08:33.424781+0000","last_active":"2019-12-19T22:08:33.424724+0000","last_peered":"2019-12-19T22:08:33.424724+0000","last_clean":"2019-12-19T22:08:33.424724+0000","last_became_active":"2019-12-19T22:08:03.373242+0000","last_became_peered":"2019-12-19T22:08:03.373242+0000","last_unstale":"2019-12-19T22:08:33.424724+0000","last_undegraded":"2019-12-19T22:08:33.424724+0000","last_fullsized":"2019-12-19T22:08:33.424724+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:33.424718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:33.424718+0000","last_clean_scrub_stamp":"2019-12-19T22:08:33.424718+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'8","reported_seq":"28","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:08:35.294802+0000","last_change":"2019-12-19T22:08:35.294857+0000","last_active":"2019-12-19T22:08:35.294802+0000","last_peered":"2019-12-19T22:08:35.294802+0000","last_clean":"2019-12-19T22:08:35.294802+0000","last_became_active":"2019-12-19T22:08:06.383672+0000","last_became_peered":"2019-12-19T22:08:06.383672+0000","last_unstale":"2019-12-19T22:08:35.294802+0000","last_undegraded":"2019-12-19T22:08:35.294802+0000","last_fullsized":"2019-12-19T22:08:35.294802+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"17'8","last_scrub_stamp":"2019-12-19T22:08:35.294795+0000","last_deep_scrub":"17'8","last_deep_scrub_stamp":"2019-12-19T22:08:35.294795+0000","last_clean_scrub_stamp":"2019-12-19T22:08:35.294795+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"18","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:08:58.417865+0000","last_change":"2019-12-19T22:08:58.417919+0000","last_active":"2019-12-19T22:08:58.417865+0000","last_peered":"2019-12-19T22:08:58.417865+0000","last_clean":"2019-12-19T22:08:58.417865+0000","last_became_active":"2019-12-19T22:08:06.717028+0000","last_became_peered":"2019-12-19T22:08:06.717028+0000","last_unstale":"2019-12-19T22:08:58.417865+0000","last_undegraded":"2019-12-19T22:08:58.417865+0000","last_fullsized":"2019-12-19T22:08:58.417865+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:58.417859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:58.417859+0000","last_clean_scrub_stamp":"2019-12-19T22:08:58.417859+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"23","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:08:31.161556+0000","last_change":"2019-12-19T22:08:31.161609+0000","last_active":"2019-12-19T22:08:31.161556+0000","last_peered":"2019-12-19T22:08:31.161556+0000","last_clean":"2019-12-19T22:08:31.161556+0000","last_became_active":"2019-12-19T22:08:03.374963+0000","last_became_peered":"2019-12-19T22:08:03.374963+0000","last_unstale":"2019-12-19T22:08:31.161556+0000","last_undegraded":"2019-12-19T22:08:31.161556+0000","last_fullsized":"2019-12-19T22:08:31.161556+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:31.161552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:31.161552+0000","last_clean_scrub_stamp":"2019-12-19T22:08:31.161552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"20","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:08:38.311092+0000","last_change":"2019-12-19T22:08:38.311172+0000","last_active":"2019-12-19T22:08:38.311092+0000","last_peered":"2019-12-19T22:08:38.311092+0000","last_clean":"2019-12-19T22:08:38.311092+0000","last_became_active":"2019-12-19T22:08:06.383871+0000","last_became_peered":"2019-12-19T22:08:06.383871+0000","last_unstale":"2019-12-19T22:08:38.311092+0000","last_undegraded":"2019-12-19T22:08:38.311092+0000","last_fullsized":"2019-12-19T22:08:38.311092+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:38.311082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:38.311082+0000","last_clean_scrub_stamp":"2019-12-19T22:08:38.311082+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"18","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:09:00.428623+0000","last_change":"2019-12-19T22:09:00.428693+0000","last_active":"2019-12-19T22:09:00.428623+0000","last_peered":"2019-12-19T22:09:00.428623+0000","last_clean":"2019-12-19T22:09:00.428623+0000","last_became_active":"2019-12-19T22:08:06.717085+0000","last_became_peered":"2019-12-19T22:08:06.717085+0000","last_unstale":"2019-12-19T22:09:00.428623+0000","last_undegraded":"2019-12-19T22:09:00.428623+0000","last_fullsized":"2019-12-19T22:09:00.428623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:09:00.428617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:09:00.428617+0000","last_clean_scrub_stamp":"2019-12-19T22:09:00.428617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"22","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:08:31.407582+0000","last_change":"2019-12-19T22:08:31.407634+0000","last_active":"2019-12-19T22:08:31.407582+0000","last_peered":"2019-12-19T22:08:31.407582+0000","last_clean":"2019-12-19T22:08:31.407582+0000","last_became_active":"2019-12-19T22:08:03.375549+0000","last_became_peered":"2019-12-19T22:08:03.375549+0000","last_unstale":"2019-12-19T22:08:31.407582+0000","last_undegraded":"2019-12-19T22:08:31.407582+0000","last_fullsized":"2019-12-19T22:08:31.407582+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:31.407576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:31.407576+0000","last_clean_scrub_stamp":"2019-12-19T22:08:31.407576+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"25'8","reported_seq":"27","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:08:40.372587+0000","last_change":"2019-12-19T22:08:40.372651+0000","last_active":"2019-12-19T22:08:40.372587+0000","last_peered":"2019-12-19T22:08:40.372587+0000","last_clean":"2019-12-19T22:08:40.372587+0000","last_became_active":"2019-12-19T22:08:06.382299+0000","last_became_peered":"2019-12-19T22:08:06.382299+0000","last_unstale":"2019-12-19T22:08:40.372587+0000","last_undegraded":"2019-12-19T22:08:40.372587+0000","last_fullsized":"2019-12-19T22:08:40.372587+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8","last_scrub_stamp":"2019-12-19T22:08:40.372576+0000","last_deep_scrub":"25'8","last_deep_scrub_stamp":"2019-12-19T22:08:40.372576+0000","last_clean_scrub_stamp":"2019-12-19T22:08:40.372576+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4620,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"18","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:08:40.357124+0000","last_change":"2019-12-19T22:08:40.357188+0000","last_active":"2019-12-19T22:08:40.357124+0000","last_peered":"2019-12-19T22:08:40.357124+0000","last_clean":"2019-12-19T22:08:40.357124+0000","last_became_active":"2019-12-19T22:08:06.716445+0000","last_became_peered":"2019-12-19T22:08:06.716445+0000","last_unstale":"2019-12-19T22:08:40.357124+0000","last_undegraded":"2019-12-19T22:08:40.357124+0000","last_fullsized":"2019-12-19T22:08:40.357124+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:40.357119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:40.357119+0000","last_clean_scrub_stamp":"2019-12-19T22:08:40.357119+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"22","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:08:32.276690+0000","last_change":"2019-12-19T22:08:32.276765+0000","last_active":"2019-12-19T22:08:32.276690+0000","last_peered":"2019-12-19T22:08:32.276690+0000","last_clean":"2019-12-19T22:08:32.276690+0000","last_became_active":"2019-12-19T22:08:03.373999+0000","last_became_peered":"2019-12-19T22:08:03.373999+0000","last_unstale":"2019-12-19T22:08:32.276690+0000","last_undegraded":"2019-12-19T22:08:32.276690+0000","last_fullsized":"2019-12-19T22:08:32.276690+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:32.276682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:32.276682+0000","last_clean_scrub_stamp":"2019-12-19T22:08:32.276682+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"17'1","reported_seq":"20","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:08:34.234456+0000","last_change":"2019-12-19T22:08:34.234511+0000","last_active":"2019-12-19T22:08:34.234456+0000","last_peered":"2019-12-19T22:08:34.234456+0000","last_clean":"2019-12-19T22:08:34.234456+0000","last_became_active":"2019-12-19T22:08:06.383420+0000","last_became_peered":"2019-12-19T22:08:06.383420+0000","last_unstale":"2019-12-19T22:08:34.234456+0000","last_undegraded":"2019-12-19T22:08:34.234456+0000","last_fullsized":"2019-12-19T22:08:34.234456+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"17'1","last_scrub_stamp":"2019-12-19T22:08:34.234450+0000","last_deep_scrub":"17'1","last_deep_scrub_stamp":"2019-12-19T22:08:34.234450+0000","last_clean_scrub_stamp":"2019-12-19T22:08:34.234450+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:08:44.270940+0000","last_change":"2019-12-19T22:08:44.270991+0000","last_active":"2019-12-19T22:08:44.270940+0000","last_peered":"2019-12-19T22:08:44.270940+0000","last_clean":"2019-12-19T22:08:44.270940+0000","last_became_active":"2019-12-19T22:08:17.394495+0000","last_became_peered":"2019-12-19T22:08:17.394495+0000","last_unstale":"2019-12-19T22:08:44.270940+0000","last_undegraded":"2019-12-19T22:08:44.270940+0000","last_fullsized":"2019-12-19T22:08:44.270940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:44.270934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:44.270934+0000","last_clean_scrub_stamp":"2019-12-19T22:08:44.270934+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"18","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:09:01.422633+0000","last_change":"2019-12-19T22:09:01.422689+0000","last_active":"2019-12-19T22:09:01.422633+0000","last_peered":"2019-12-19T22:09:01.422633+0000","last_clean":"2019-12-19T22:09:01.422633+0000","last_became_active":"2019-12-19T22:08:06.717289+0000","last_became_peered":"2019-12-19T22:08:06.717289+0000","last_unstale":"2019-12-19T22:09:01.422633+0000","last_undegraded":"2019-12-19T22:09:01.422633+0000","last_fullsized":"2019-12-19T22:09:01.422633+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:09:01.422629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:09:01.422629+0000","last_clean_scrub_stamp":"2019-12-19T22:09:01.422629+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"22","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:08:37.333198+0000","last_change":"2019-12-19T22:08:37.333245+0000","last_active":"2019-12-19T22:08:37.333198+0000","last_peered":"2019-12-19T22:08:37.333198+0000","last_clean":"2019-12-19T22:08:37.333198+0000","last_became_active":"2019-12-19T22:08:03.375236+0000","last_became_peered":"2019-12-19T22:08:03.375236+0000","last_unstale":"2019-12-19T22:08:37.333198+0000","last_undegraded":"2019-12-19T22:08:37.333198+0000","last_fullsized":"2019-12-19T22:08:37.333198+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:37.333192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:37.333192+0000","last_clean_scrub_stamp":"2019-12-19T22:08:37.333192+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"25'10","reported_seq":"29","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:08:46.385978+0000","last_change":"2019-12-19T22:08:46.386027+0000","last_active":"2019-12-19T22:08:46.385978+0000","last_peered":"2019-12-19T22:08:46.385978+0000","last_clean":"2019-12-19T22:08:46.385978+0000","last_became_active":"2019-12-19T22:08:06.382181+0000","last_became_peered":"2019-12-19T22:08:06.382181+0000","last_unstale":"2019-12-19T22:08:46.385978+0000","last_undegraded":"2019-12-19T22:08:46.385978+0000","last_fullsized":"2019-12-19T22:08:46.385978+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'10","last_scrub_stamp":"2019-12-19T22:08:46.385972+0000","last_deep_scrub":"25'10","last_deep_scrub_stamp":"2019-12-19T22:08:46.385972+0000","last_clean_scrub_stamp":"2019-12-19T22:08:46.385972+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":"15","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:09:06.460158+0000","last_change":"2019-12-19T22:09:06.460226+0000","last_active":"2019-12-19T22:09:06.460158+0000","last_peered":"2019-12-19T22:09:06.460158+0000","last_clean":"2019-12-19T22:09:06.460158+0000","last_became_active":"2019-12-19T22:08:17.393478+0000","last_became_peered":"2019-12-19T22:08:17.393478+0000","last_unstale":"2019-12-19T22:09:06.460158+0000","last_undegraded":"2019-12-19T22:09:06.460158+0000","last_fullsized":"2019-12-19T22:09:06.460158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:09:06.460153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:09:06.460153+0000","last_clean_scrub_stamp":"2019-12-19T22:09:06.460153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"19","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:08:43.389610+0000","last_change":"2019-12-19T22:08:43.389684+0000","last_active":"2019-12-19T22:08:43.389610+0000","last_peered":"2019-12-19T22:08:43.389610+0000","last_clean":"2019-12-19T22:08:43.389610+0000","last_became_active":"2019-12-19T22:08:06.718242+0000","last_became_peered":"2019-12-19T22:08:06.718242+0000","last_unstale":"2019-12-19T22:08:43.389610+0000","last_undegraded":"2019-12-19T22:08:43.389610+0000","last_fullsized":"2019-12-19T22:08:43.389610+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:43.389601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:43.389601+0000","last_clean_scrub_stamp":"2019-12-19T22:08:43.389601+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"22","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:08:38.328287+0000","last_change":"2019-12-19T22:08:38.328350+0000","last_active":"2019-12-19T22:08:38.328287+0000","last_peered":"2019-12-19T22:08:38.328287+0000","last_clean":"2019-12-19T22:08:38.328287+0000","last_became_active":"2019-12-19T22:08:03.372918+0000","last_became_peered":"2019-12-19T22:08:03.372918+0000","last_unstale":"2019-12-19T22:08:38.328287+0000","last_undegraded":"2019-12-19T22:08:38.328287+0000","last_fullsized":"2019-12-19T22:08:38.328287+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-19T22:08:38.328281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-19T22:08:38.328281+0000","last_clean_scrub_stamp":"2019-12-19T22:08:38.328281+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"25'13","reported_seq":"32","reported_epoch":"25","state":"active+clean","last_fresh":"2019-12-19T22:08:45.351089+0000","last_change":"2019-12-19T22:08:45.351155+0000","last_active":"2019-12-19T22:08:45.351089+0000","last_peered":"2019-12-19T22:08:45.351089+0000","last_clean":"2019-12-19T22:08:45.351089+0000","last_became_active":"2019-12-19T22:08:06.384716+0000","last_became_peered":"2019-12-19T22:08:06.384716+0000","last_unstale":"2019-12-19T22:08:45.351089+0000","last_undegraded":"2019-12-19T22:08:45.351089+0000","last_fullsized":"2019-12-19T22:08:45.351089+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'13","last_scrub_stamp":"2019-12-19T22:08:45.351079+0000","last_deep_scrub":"25'13","last_deep_scrub_stamp":"2019-12-19T22:08:45.351079+0000","last_clean_scrub_stamp":"2019-12-19T22:08:45.351079+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1946,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":4,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":8,"acting":8,"num_store_stats":3},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":2706,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4620,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":57,"ondisk_log_size":57,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705680,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048824,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808776,"statfs":{"total":107374182400,"available":106300186624,"internally_reserved":1073741824,"allocated":245760,"data_stored":82814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 19 22:09:01 2019","interfaces":[{"interface":"back","average":{"1min":0.332,"5min":0.332,"15min":0.332},"min":{"1min":0.213,"5min":0.213,"15min":0.213},"max":{"1min":0.484,"5min":0.484,"15min":0.484},"last":0.383},{"interface":"front","average":{"1min":0.312,"5min":0.312,"15min":0.312},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.462,"5min":0.462,"15min":0.462},"last":0.317}]},{"osd":2,"last update":"Thu Dec 19 22:09:01 2019","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.309,"15min":0.309},"min":{"1min":0.201,"5min":0.201,"15min":0.201},"max":{"1min":0.486,"5min":0.486,"15min":0.486},"last":0.361},{"interface":"front","average":{"1min":0.335,"5min":0.335,"15min":0.335},"min":{"1min":0.207,"5min":0.207,"15min":0.207},"max":{"1min":0.527,"5min":0.527,"15min":0.527},"last":0.332}]}]},{"osd":2,"up_from":8,"seq":34359738385,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048796,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808804,"statfs":{"total":107374182400,"available":106300215296,"internally_reserved":1073741824,"allocated":217088,"data_stored":80142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 19 22:09:02 2019","interfaces":[{"interface":"back","average":{"1min":0.268,"5min":0.268,"15min":0.268},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.458,"5min":0.458,"15min":0.458},"last":0.276},{"interface":"front","average":{"1min":0.318,"5min":0.318,"15min":0.318},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.503,"5min":0.503,"15min":0.503},"last":0.389}]},{"osd":1,"last update":"Thu Dec 19 22:09:02 2019","interfaces":[{"interface":"back","average":{"1min":0.294,"5min":0.294,"15min":0.294},"min":{"1min":0.194,"5min":0.194,"15min":0.194},"max":{"1min":0.442,"5min":0.442,"15min":0.442},"last":0.365},{"interface":"front","average":{"1min":0.334,"5min":0.334,"15min":0.334},"min":{"1min":0.234,"5min":0.234,"15min":0.234},"max":{"1min":0.536,"5min":0.536,"15min":0.536},"last":0.331}]}]},{"osd":0,"up_from":9,"seq":38654705681,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808780,"statfs":{"total":107374182400,"available":106300190720,"internally_reserved":1073741824,"allocated":241664,"data_stored":82780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 19 22:08:58 2019","interfaces":[{"interface":"back","average":{"1min":0.321,"5min":0.321,"15min":0.321},"min":{"1min":0.210,"5min":0.210,"15min":0.210},"max":{"1min":0.453,"5min":0.453,"15min":0.453},"last":0.328},{"interface":"front","average":{"1min":0.298,"5min":0.298,"15min":0.298},"min":{"1min":0.202,"5min":0.202,"15min":0.202},"max":{"1min":0.411,"5min":0.411,"15min":0.411},"last":0.366}]},{"osd":2,"last update":"Thu Dec 19 22:08:58 2019","interfaces":[{"interface":"back","average":{"1min":0.336,"5min":0.336,"15min":0.336},"min":{"1min":0.176,"5min":0.176,"15min":0.176},"max":{"1min":0.448,"5min":0.448,"15min":0.448},"last":0.423},{"interface":"front","average":{"1min":0.303,"5min":0.303,"15min":0.303},"min":{"1min":0.211,"5min":0.211,"15min":0.211},"max":{"1min":0.452,"5min":0.452,"15min":0.452},"last":0.406}]}]}]}} 2019-12-19T22:09:11.053 INFO:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph --mon-client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health-to-clog 2019-12-19T22:09:11.184 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.174+0000 7f8bf544f700 1 Processor -- start 2019-12-19T22:09:11.185 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.174+0000 7f8bf544f700 1 -- start start 2019-12-19T22:09:11.185 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.174+0000 7f8bf544f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8bf007df60 0x7f8bf007e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2019-12-19T22:09:11.185 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.174+0000 7f8bf544f700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bf007d940 con 0x7f8bf0089310 2019-12-19T22:09:11.185 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.174+0000 7f8bf544f700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bf007e8e0 con 0x7f8bf007df60 2019-12-19T22:09:11.185 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.175+0000 7f8bef7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8bf007df60 0x7f8bf007e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:09:11.185 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.175+0000 7f8be7fff700 1 --1- >> v1:172.21.15.50:6789/0 conn(0x7f8bf0089310 0x7f8bf0089740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.50:6789/0 says I am v1:172.21.15.50:40174/0 (socket says 172.21.15.50:40174) 2019-12-19T22:09:11.185 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.175+0000 7f8be7fff700 1 -- 172.21.15.50:0/175859222 learned_addr learned my addr 172.21.15.50:0/175859222 (peer_addr_for_me v1:172.21.15.50:0/0) 2019-12-19T22:09:11.186 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.175+0000 7f8bef7fe700 1 -- 172.21.15.50:0/175859222 >> v1:172.21.15.50:6789/0 conn(0x7f8bf0089310 legacy=0x7f8bf0089740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:09:11.186 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.175+0000 7f8bef7fe700 1 -- 172.21.15.50:0/175859222 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf007dc50 con 0x7f8bf007df60 2019-12-19T22:09:11.186 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.175+0000 7f8bef7fe700 1 --2- 172.21.15.50:0/175859222 >> v2:172.21.15.50:3300/0 conn(0x7f8bf007df60 0x7f8bf007e390 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8be0002f30 tx=0x7f8be000fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:09:11.186 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.175+0000 7f8bef7fe700 1 --2- 172.21.15.50:0/175859222 >> v2:172.21.15.50:3300/0 conn(0x7f8bf007df60 0x7f8bf007e390 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8be0002f30 tx=0x7f8be000fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:09:11.186 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.175+0000 7f8bef7fe700 1 --2- 172.21.15.50:0/175859222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf007df60 0x7f8bf007e390 secure :-1 s=READY pgs=295 cs=0 l=1 rx=0x7f8be0002f30 tx=0x7f8be000fbf0).ready entity=mon.0 client_cookie=d8b4376bdc77b7fe server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:09:11.186 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.175+0000 7f8bef7fe700 1 --2- 172.21.15.50:0/175859222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf007df60 0x7f8bf007e390 secure :-1 s=THROTTLE_DONE pgs=295 cs=0 l=1 rx=0x7f8be0002f30 tx=0x7f8be000fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:09:11.186 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.175+0000 7f8beeffd700 1 -- 172.21.15.50:0/175859222 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f8be0011230 con 0x7f8bf007df60 2019-12-19T22:09:11.187 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.175+0000 7f8bef7fe700 1 --2- 172.21.15.50:0/175859222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf007df60 0x7f8bf007e390 secure :-1 s=THROTTLE_DONE pgs=295 cs=0 l=1 rx=0x7f8be0002f30 tx=0x7f8be000fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:09:11.187 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.175+0000 7f8bef7fe700 1 --2- 172.21.15.50:0/175859222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf007df60 0x7f8bf007e390 secure :-1 s=THROTTLE_DONE pgs=295 cs=0 l=1 rx=0x7f8be0002f30 tx=0x7f8be000fbf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:09:11.187 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.175+0000 7f8beeffd700 1 -- 172.21.15.50:0/175859222 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be0011430 con 0x7f8bf007df60 2019-12-19T22:09:11.187 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.175+0000 7f8beeffd700 1 -- 172.21.15.50:0/175859222 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f8be0011790 con 0x7f8bf007df60 2019-12-19T22:09:11.187 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.175+0000 7f8bf544f700 1 -- 172.21.15.50:0/175859222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf007df60 msgr2=0x7f8bf007e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:09:11.187 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.175+0000 7f8bf544f700 1 --2- 172.21.15.50:0/175859222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf007df60 0x7f8bf007e390 secure :-1 s=READY pgs=295 cs=0 l=1 rx=0x7f8be0002f30 tx=0x7f8be000fbf0).stop 2019-12-19T22:09:11.187 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.176+0000 7f8bf544f700 1 -- 172.21.15.50:0/175859222 shutdown_connections 2019-12-19T22:09:11.188 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.176+0000 7f8bf544f700 1 --2- 172.21.15.50:0/175859222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf007df60 0x7f8bf007e390 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:09:11.188 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.176+0000 7f8bf544f700 1 -- 172.21.15.50:0/175859222 shutdown_connections 2019-12-19T22:09:11.188 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.176+0000 7f8bf544f700 1 -- 172.21.15.50:0/175859222 wait complete. 2019-12-19T22:09:11.188 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.176+0000 7f8bf544f700 1 -- 172.21.15.50:0/175859222 >> 172.21.15.50:0/175859222 conn(0x7f8bf0094640 msgr2=0x7f8bf0094a70 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:09:11.188 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.177+0000 7f8bf544f700 1 Processor -- start 2019-12-19T22:09:11.188 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.177+0000 7f8bf544f700 1 -- start start 2019-12-19T22:09:11.188 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.177+0000 7f8bf544f700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8bf007a3f0 0x7f8bf007a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:09:11.189 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.177+0000 7f8bf544f700 1 -- --> v1:172.21.15.50:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bf0060090 con 0x7f8bf007c120 2019-12-19T22:09:11.189 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.177+0000 7f8bf544f700 1 -- --> v2:172.21.15.50:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bf0061390 con 0x7f8bf007a3f0 2019-12-19T22:09:11.189 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.178+0000 7f8bef7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8bf007a3f0 0x7f8bf007a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:09:11.189 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.178+0000 7f8bef7fe700 1 --2- >> v2:172.21.15.50:3300/0 conn(0x7f8bf007a3f0 0x7f8bf007a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:54048/0 (socket says 172.21.15.50:54048) 2019-12-19T22:09:11.189 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.178+0000 7f8bef7fe700 1 -- 172.21.15.50:0/1645397776 learned_addr learned my addr 172.21.15.50:0/1645397776 (peer_addr_for_me v2:172.21.15.50:0/0) 2019-12-19T22:09:11.189 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.178+0000 7f8bef7fe700 1 -- 172.21.15.50:0/1645397776 >> v1:172.21.15.50:6789/0 conn(0x7f8bf007c120 legacy=0x7f8bf007c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:09:11.189 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.178+0000 7f8bef7fe700 1 -- 172.21.15.50:0/1645397776 --> v2:172.21.15.50:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf0060a20 con 0x7f8bf007a3f0 2019-12-19T22:09:11.190 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.178+0000 7f8bef7fe700 1 --2- 172.21.15.50:0/1645397776 >> v2:172.21.15.50:3300/0 conn(0x7f8bf007a3f0 0x7f8bf007a820 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8bf0060da0 tx=0x7f8be000f7b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:09:11.190 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.178+0000 7f8bef7fe700 1 --2- 172.21.15.50:0/1645397776 >> v2:172.21.15.50:3300/0 conn(0x7f8bf007a3f0 0x7f8bf007a820 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8bf0060da0 tx=0x7f8be000f7b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:09:11.190 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.178+0000 7f8bef7fe700 1 --2- 172.21.15.50:0/1645397776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf007a3f0 0x7f8bf007a820 secure :-1 s=READY pgs=297 cs=0 l=1 rx=0x7f8bf0060da0 tx=0x7f8be000f7b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:09:11.190 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.178+0000 7f8bef7fe700 1 --2- 172.21.15.50:0/1645397776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf007a3f0 0x7f8bf007a820 secure :-1 s=THROTTLE_DONE pgs=297 cs=0 l=1 rx=0x7f8bf0060da0 tx=0x7f8be000f7b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:09:11.190 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.178+0000 7f8becff9700 1 -- 172.21.15.50:0/1645397776 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f8be0007280 con 0x7f8bf007a3f0 2019-12-19T22:09:11.190 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.178+0000 7f8bef7fe700 1 --2- 172.21.15.50:0/1645397776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf007a3f0 0x7f8bf007a820 secure :-1 s=THROTTLE_DONE pgs=297 cs=0 l=1 rx=0x7f8bf0060da0 tx=0x7f8be000f7b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:09:11.190 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.178+0000 7f8becff9700 1 -- 172.21.15.50:0/1645397776 <== mon.0 v2:172.21.15.50:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be0007480 con 0x7f8bf007a3f0 2019-12-19T22:09:11.191 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.178+0000 7f8bef7fe700 1 --2- 172.21.15.50:0/1645397776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf007a3f0 0x7f8bf007a820 secure :-1 s=THROTTLE_DONE pgs=297 cs=0 l=1 rx=0x7f8bf0060da0 tx=0x7f8be000f7b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:09:11.191 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.178+0000 7f8bf544f700 1 -- 172.21.15.50:0/1645397776 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bf0082420 con 0x7f8bf007a3f0 2019-12-19T22:09:11.191 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.178+0000 7f8becff9700 1 -- 172.21.15.50:0/1645397776 <== mon.0 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f8be00115c0 con 0x7f8bf007a3f0 2019-12-19T22:09:11.191 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.178+0000 7f8bf544f700 1 -- 172.21.15.50:0/1645397776 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bf007ad70 con 0x7f8bf007a3f0 2019-12-19T22:09:11.191 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.179+0000 7f8bef7fe700 1 --2- 172.21.15.50:0/1645397776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf007a3f0 0x7f8bf007a820 secure :-1 s=THROTTLE_DONE pgs=297 cs=0 l=1 rx=0x7f8bf0060da0 tx=0x7f8be000f7b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:09:11.191 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.179+0000 7f8becff9700 1 -- 172.21.15.50:0/1645397776 <== mon.0 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 3) v1 ==== 23114+0+0 (secure 0 0 0) 0x7f8be0005540 con 0x7f8bf007a3f0 2019-12-19T22:09:11.191 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.179+0000 7f8bef7fe700 1 --2- 172.21.15.50:0/1645397776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf007a3f0 0x7f8bf007a820 secure :-1 s=THROTTLE_DONE pgs=297 cs=0 l=1 rx=0x7f8bf0060da0 tx=0x7f8be000f7b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:09:11.192 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.179+0000 7f8becff9700 1 --2- 172.21.15.50:0/1645397776 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f8bd401fa30 0x7f8bd4021f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:09:11.192 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.179+0000 7f8becff9700 1 -- 172.21.15.50:0/1645397776 <== mon.0 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3786+0+0 (secure 0 0 0) 0x7f8be002ac80 con 0x7f8bf007a3f0 2019-12-19T22:09:11.192 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.179+0000 7f8be7fff700 1 --2- 172.21.15.50:0/1645397776 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f8bd401fa30 0x7f8bd4021f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:09:11.192 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.179+0000 7f8be7fff700 1 --2- 172.21.15.50:0/1645397776 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f8bd401fa30 0x7f8bd4021f40 crc :-1 s=READY pgs=72 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:09:11.193 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.180+0000 7f8bf544f700 1 -- 172.21.15.50:0/1645397776 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8bf0056340 con 0x7f8bf007a3f0 2019-12-19T22:09:11.193 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.180+0000 7f8bef7fe700 1 --2- 172.21.15.50:0/1645397776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf007a3f0 0x7f8bf007a820 secure :-1 s=THROTTLE_DONE pgs=297 cs=0 l=1 rx=0x7f8bf0060da0 tx=0x7f8be000f7b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:09:11.193 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.180+0000 7f8becff9700 1 -- 172.21.15.50:0/1645397776 <== mon.0 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+563 (secure 0 0 0) 0x7f8be00097c0 con 0x7f8bf007a3f0 2019-12-19T22:09:11.193 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.180+0000 7f8bf544f700 1 --2- 172.21.15.50:0/1645397776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf007cd50 0x7f8bf0092cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:09:11.193 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.180+0000 7f8bf544f700 1 -- 172.21.15.50:0/1645397776 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf0066470 con 0x7f8bf007cd50 2019-12-19T22:09:11.194 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.180+0000 7f8beffff700 1 --2- 172.21.15.50:0/1645397776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf007cd50 0x7f8bf0092cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:09:11.194 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.180+0000 7f8beffff700 1 -- 172.21.15.50:0/1645397776 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- command(tid 2: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8bf00008d0 con 0x7f8bf007cd50 2019-12-19T22:09:11.194 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.180+0000 7f8beffff700 1 --2- 172.21.15.50:0/1645397776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf007cd50 0x7f8bf0092cc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8be8003230 tx=0x7f8be8010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:09:11.194 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.181+0000 7f8beffff700 1 --2- 172.21.15.50:0/1645397776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf007cd50 0x7f8bf0092cc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8be8003230 tx=0x7f8be8010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:09:11.194 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.181+0000 7f8beffff700 1 --2- 172.21.15.50:0/1645397776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf007cd50 0x7f8bf0092cc0 secure :-1 s=READY pgs=298 cs=0 l=1 rx=0x7f8be8003230 tx=0x7f8be8010a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:09:11.194 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.181+0000 7f8beffff700 1 --2- 172.21.15.50:0/1645397776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf007cd50 0x7f8bf0092cc0 secure :-1 s=THROTTLE_DONE pgs=298 cs=0 l=1 rx=0x7f8be8003230 tx=0x7f8be8010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:09:11.194 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.181+0000 7f8becff9700 1 -- 172.21.15.50:0/1645397776 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f8be80059d0 con 0x7f8bf007cd50 2019-12-19T22:09:11.194 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.181+0000 7f8beffff700 1 --2- 172.21.15.50:0/1645397776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf007cd50 0x7f8bf0092cc0 secure :-1 s=THROTTLE_DONE pgs=298 cs=0 l=1 rx=0x7f8be8003230 tx=0x7f8be8010a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:09:11.195 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.181+0000 7f8becff9700 1 -- 172.21.15.50:0/1645397776 <== mon.0 v2:172.21.15.50:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+7841 (secure 0 0 0) 0x7f8be8005bd0 con 0x7f8bf007cd50 2019-12-19T22:09:11.195 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.181+0000 7f8becff9700 1 -- 172.21.15.50:0/1645397776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf007cd50 msgr2=0x7f8bf0092cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:09:11.195 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.181+0000 7f8becff9700 1 --2- 172.21.15.50:0/1645397776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf007cd50 0x7f8bf0092cc0 secure :-1 s=READY pgs=298 cs=0 l=1 rx=0x7f8be8003230 tx=0x7f8be8010a40).stop 2019-12-19T22:09:11.195 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.181+0000 7f8becff9700 1 -- 172.21.15.50:0/1645397776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf007cd50 msgr2=0x7f8bf0092cc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2019-12-19T22:09:11.195 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.181+0000 7f8becff9700 1 --2- 172.21.15.50:0/1645397776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf007cd50 0x7f8bf0092cc0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:09:11.198 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.189+0000 7f8bf544f700 1 --2- 172.21.15.50:0/1645397776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf007ece0 0x7f8bf007f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2019-12-19T22:09:11.198 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.189+0000 7f8bf544f700 1 -- 172.21.15.50:0/1645397776 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf0065fb0 con 0x7f8bf007ece0 2019-12-19T22:09:11.198 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.189+0000 7f8beffff700 1 --2- 172.21.15.50:0/1645397776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf007ece0 0x7f8bf007f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2019-12-19T22:09:11.198 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.190+0000 7f8beffff700 1 -- 172.21.15.50:0/1645397776 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- command(tid 3: {"prefix": "injectargs", "injected_args": ["--no-mon-health-to-clog"]}) v1 -- 0x7f8bf0093210 con 0x7f8bf007ece0 2019-12-19T22:09:11.198 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.190+0000 7f8beffff700 1 --2- 172.21.15.50:0/1645397776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf007ece0 0x7f8bf007f110 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8be8003230 tx=0x7f8be80075e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:09:11.198 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.190+0000 7f8beffff700 1 --2- 172.21.15.50:0/1645397776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf007ece0 0x7f8bf007f110 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8be8003230 tx=0x7f8be80075e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:09:11.199 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.190+0000 7f8beffff700 1 --2- 172.21.15.50:0/1645397776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf007ece0 0x7f8bf007f110 secure :-1 s=READY pgs=299 cs=0 l=1 rx=0x7f8be8003230 tx=0x7f8be80075e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2019-12-19T22:09:11.199 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.190+0000 7f8beffff700 1 --2- 172.21.15.50:0/1645397776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf007ece0 0x7f8bf007f110 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7f8be8003230 tx=0x7f8be80075e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:09:11.199 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.190+0000 7f8becff9700 1 -- 172.21.15.50:0/1645397776 <== mon.0 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 v1 ==== 183+0+0 (secure 0 0 0) 0x7f8be8001850 con 0x7f8bf007ece0 2019-12-19T22:09:11.199 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.191+0000 7f8beffff700 1 --2- 172.21.15.50:0/1645397776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf007ece0 0x7f8bf007f110 secure :-1 s=THROTTLE_DONE pgs=299 cs=0 l=1 rx=0x7f8be8003230 tx=0x7f8be80075e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2019-12-19T22:09:11.199 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.191+0000 7f8becff9700 1 -- 172.21.15.50:0/1645397776 <== mon.0 v2:172.21.15.50:3300/0 2 ==== command_reply(tid 3: 0 mon_health_to_clog = 'false' ) v1 ==== 37+0+3 (secure 0 0 0) 0x7f8be8001af0 con 0x7f8bf007ece0 2019-12-19T22:09:11.199 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.191+0000 7f8becff9700 1 -- 172.21.15.50:0/1645397776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf007ece0 msgr2=0x7f8bf007f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:09:11.199 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.191+0000 7f8becff9700 1 --2- 172.21.15.50:0/1645397776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf007ece0 0x7f8bf007f110 secure :-1 s=READY pgs=299 cs=0 l=1 rx=0x7f8be8003230 tx=0x7f8be80075e0).stop 2019-12-19T22:09:11.199 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.191+0000 7f8becff9700 1 -- 172.21.15.50:0/1645397776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf007ece0 msgr2=0x7f8bf007f110 secure :-1 s=STATE_CLOSED l=1).mark_down 2019-12-19T22:09:11.200 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.191+0000 7f8becff9700 1 --2- 172.21.15.50:0/1645397776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf007ece0 0x7f8bf007f110 secure :-1 s=CLOSED pgs=299 cs=0 l=1 rx=0x7f8be8003230 tx=0x7f8be80075e0).stop 2019-12-19T22:09:11.200 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.191+0000 7f8bf544f700 1 -- 172.21.15.50:0/1645397776 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f8bd401fa30 msgr2=0x7f8bd4021f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:09:11.200 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.191+0000 7f8bf544f700 1 --2- 172.21.15.50:0/1645397776 >> [v2:172.21.15.50:6824/27190,v1:172.21.15.50:6825/27190] conn(0x7f8bd401fa30 0x7f8bd4021f40 crc :-1 s=READY pgs=72 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:09:11.200 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.191+0000 7f8bf544f700 1 -- 172.21.15.50:0/1645397776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf007a3f0 msgr2=0x7f8bf007a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2019-12-19T22:09:11.200 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.191+0000 7f8bf544f700 1 --2- 172.21.15.50:0/1645397776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf007a3f0 0x7f8bf007a820 secure :-1 s=READY pgs=297 cs=0 l=1 rx=0x7f8bf0060da0 tx=0x7f8be000f7b0).stop 2019-12-19T22:09:11.200 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.191+0000 7f8beffff700 1 -- 172.21.15.50:0/1645397776 reap_dead start 2019-12-19T22:09:11.200 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.191+0000 7f8bf544f700 1 -- 172.21.15.50:0/1645397776 shutdown_connections 2019-12-19T22:09:11.201 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.191+0000 7f8bf544f700 1 --2- 172.21.15.50:0/1645397776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8bf007a3f0 0x7f8bf007a820 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rx=0 tx=0).stop 2019-12-19T22:09:11.201 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.191+0000 7f8bf544f700 1 -- 172.21.15.50:0/1645397776 shutdown_connections 2019-12-19T22:09:11.201 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.192+0000 7f8bf544f700 1 -- 172.21.15.50:0/1645397776 wait complete. 2019-12-19T22:09:11.201 INFO:teuthology.orchestra.run.smithi050.stderr:2019-12-19T22:09:11.192+0000 7f8bf544f700 1 -- 172.21.15.50:0/1645397776 >> 172.21.15.50:0/1645397776 conn(0x7f8bf007d230 msgr2=0x7f8bf00924c0 unknown :-1 s=STATE_NONE l=0).mark_down 2019-12-19T22:09:11.201 INFO:teuthology.orchestra.run.smithi050.stderr:mon_health_to_clog = 'false' 2019-12-19T22:09:11.201 INFO:teuthology.orchestra.run.smithi050.stdout:{} 2019-12-19T22:09:11.204 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/contextutil.py", line 34, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_wip-sjust-read-from-replica/qa/tasks/ceph.py", line 1908, in task yield File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 89, in run_tasks manager.__enter__() File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/home/teuthworker/src/github.com_ceph_ceph-c_wip-sjust-read-from-replica/qa/tasks/ceph_fuse.py", line 135, in task mount.mount() File "/home/teuthworker/src/github.com_ceph_ceph-c_wip-sjust-read-from-replica/qa/tasks/cephfs/fuse_mount.py", line 33, in mount return self._mount(mount_path, mount_fs_name) File "/home/teuthworker/src/github.com_ceph_ceph-c_wip-sjust-read-from-replica/qa/tasks/cephfs/fuse_mount.py", line 158, in _mount self.gather_mount_info() File "/home/teuthworker/src/github.com_ceph_ceph-c_wip-sjust-read-from-replica/qa/tasks/cephfs/fuse_mount.py", line 161, in gather_mount_info status = self.admin_socket(['status']) File "/home/teuthworker/src/github.com_ceph_ceph-c_wip-sjust-read-from-replica/qa/tasks/cephfs/fuse_mount.py", line 440, in admin_socket ], stdout=StringIO(), timeout=(15*60)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 198, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 433, in run r.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 158, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 180, in _raise_for_status node=self.hostname, label=self.label CommandFailedError: Command failed on smithi050 with status 1: 'sudo python2 -c \'\nimport glob\nimport re\nimport os\nimport subprocess\n\ndef find_socket(client_name):\n asok_path = "/var/run/ceph/ceph-client.1.*.asok"\n files = glob.glob(asok_path)\n\n # Given a non-glob path, it better be there\n if "*" not in asok_path:\n assert(len(files) == 1)\n return files[0]\n\n for f in files:\n pid = re.match(".*\\.(\\d+)\\.asok$", f).group(1)\n if os.path.exists("/proc/{0}".format(pid)):\n return f\n raise RuntimeError("Client socket {0} not found".format(client_name))\n\nprint(find_socket("client.1"))\n\'' 2019-12-19T22:09:11.205 INFO:teuthology.misc:Shutting down mds daemons... 2019-12-19T22:09:11.206 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2019-12-19T22:09:11.206 INFO:teuthology.orchestra.run:waiting for 300 2019-12-19T22:09:11.214 INFO:tasks.ceph.mds.a:Stopped 2019-12-19T22:09:11.214 INFO:teuthology.misc:Shutting down osd daemons... 2019-12-19T22:09:11.214 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2019-12-19T22:09:11.215 INFO:teuthology.orchestra.run:waiting for 300 2019-12-19T22:09:11.277 INFO:tasks.ceph.osd.1:Stopped 2019-12-19T22:09:11.277 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2019-12-19T22:09:11.278 INFO:teuthology.orchestra.run:waiting for 300 2019-12-19T22:09:11.314 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2019-12-19T22:09:11.348 INFO:tasks.ceph.osd.0:Stopped 2019-12-19T22:09:11.348 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2019-12-19T22:09:11.348 INFO:teuthology.orchestra.run:waiting for 300 2019-12-19T22:09:11.412 INFO:tasks.ceph.osd.2:Stopped 2019-12-19T22:09:11.412 INFO:teuthology.misc:Shutting down mgr daemons... 2019-12-19T22:09:11.413 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2019-12-19T22:09:11.413 INFO:teuthology.orchestra.run:waiting for 300 2019-12-19T22:09:11.469 INFO:tasks.ceph.mgr.x:Stopped 2019-12-19T22:09:11.469 INFO:teuthology.misc:Shutting down mon daemons... 2019-12-19T22:09:11.469 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2019-12-19T22:09:11.469 INFO:teuthology.orchestra.run:waiting for 300 2019-12-19T22:09:11.518 INFO:tasks.ceph.mon.a:Stopped 2019-12-19T22:09:11.518 INFO:tasks.ceph:Checking cluster log for badness... 2019-12-19T22:09:11.519 INFO:teuthology.orchestra.run.smithi050:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2019-12-19T22:09:11.591 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi050.front.sepia.ceph.com 2019-12-19T22:09:11.591 INFO:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2019-12-19T22:09:11.852 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi050.front.sepia.ceph.com 2019-12-19T22:09:11.852 INFO:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2019-12-19T22:09:11.967 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi050.front.sepia.ceph.com 2019-12-19T22:09:11.967 INFO:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2019-12-19T22:09:12.063 INFO:tasks.ceph:Archiving mon data... 2019-12-19T22:09:12.065 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/sjust-2019-12-19_20:06:11-rados-wip-sjust-read-from-replica-distro-basic-smithi/4615662/data/mon.a.tgz 2019-12-19T22:09:12.065 INFO:teuthology.orchestra.run.smithi050:> mktemp 2019-12-19T22:09:12.080 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.WIuWYoSwOF 2019-12-19T22:09:12.080 INFO:teuthology.orchestra.run.smithi050:> sudo tar cz -f /tmp/tmp.WIuWYoSwOF -C /var/lib/ceph/mon/ceph-a -- . 2019-12-19T22:09:12.205 INFO:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.WIuWYoSwOF 2019-12-19T22:09:12.292 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.WIuWYoSwOF is 201KB 2019-12-19T22:09:12.349 INFO:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.WIuWYoSwOF 2019-12-19T22:09:12.363 INFO:tasks.ceph:Cleaning ceph cluster... 2019-12-19T22:09:12.363 INFO:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2019-12-19T22:09:12.434 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2019-12-19T22:09:12.434 INFO:teuthology.orchestra.run.smithi050:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2019-12-19T22:09:12.506 INFO:teuthology.orchestra.run.smithi050.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2019-12-19T22:09:12.512 INFO:tasks.ceph:Archiving crash dumps... 2019-12-19T22:09:12.522 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/crash to /home/teuthworker/archive/sjust-2019-12-19_20:06:11-rados-wip-sjust-read-from-replica-distro-basic-smithi/4615662/remote/smithi050/crash 2019-12-19T22:09:12.523 INFO:teuthology.orchestra.run.smithi050:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2019-12-19T22:09:12.588 INFO:tasks.ceph:Compressing logs... 2019-12-19T22:09:12.588 INFO:teuthology.orchestra.run.smithi050:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2019-12-19T22:09:12.885 INFO:tasks.ceph:Archiving logs... 2019-12-19T22:09:12.886 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/log/ceph to /home/teuthworker/archive/sjust-2019-12-19_20:06:11-rados-wip-sjust-read-from-replica-distro-basic-smithi/4615662/remote/smithi050/log 2019-12-19T22:09:12.887 INFO:teuthology.orchestra.run.smithi050:> sudo tar cz -f - -C /var/log/ceph -- . 2019-12-19T22:09:13.017 DEBUG:teuthology.run_tasks:Unwinding manager install 2019-12-19T22:09:13.071 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/contextutil.py", line 34, in nested yield vars File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/install/__init__.py", line 599, in task yield File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 89, in run_tasks manager.__enter__() File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/home/teuthworker/src/github.com_ceph_ceph-c_wip-sjust-read-from-replica/qa/tasks/ceph_fuse.py", line 135, in task mount.mount() File "/home/teuthworker/src/github.com_ceph_ceph-c_wip-sjust-read-from-replica/qa/tasks/cephfs/fuse_mount.py", line 33, in mount return self._mount(mount_path, mount_fs_name) File "/home/teuthworker/src/github.com_ceph_ceph-c_wip-sjust-read-from-replica/qa/tasks/cephfs/fuse_mount.py", line 158, in _mount self.gather_mount_info() File "/home/teuthworker/src/github.com_ceph_ceph-c_wip-sjust-read-from-replica/qa/tasks/cephfs/fuse_mount.py", line 161, in gather_mount_info status = self.admin_socket(['status']) File "/home/teuthworker/src/github.com_ceph_ceph-c_wip-sjust-read-from-replica/qa/tasks/cephfs/fuse_mount.py", line 440, in admin_socket ], stdout=StringIO(), timeout=(15*60)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 198, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 433, in run r.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 158, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 180, in _raise_for_status node=self.hostname, label=self.label CommandFailedError: Command failed on smithi050 with status 1: 'sudo python2 -c \'\nimport glob\nimport re\nimport os\nimport subprocess\n\ndef find_socket(client_name):\n asok_path = "/var/run/ceph/ceph-client.1.*.asok"\n files = glob.glob(asok_path)\n\n # Given a non-glob path, it better be there\n if "*" not in asok_path:\n assert(len(files) == 1)\n return files[0]\n\n for f in files:\n pid = re.match(".*\\.(\\d+)\\.asok$", f).group(1)\n if os.path.exists("/proc/{0}".format(pid)):\n return f\n raise RuntimeError("Client socket {0} not found".format(client_name))\n\nprint(find_socket("client.1"))\n\'' 2019-12-19T22:09:13.072 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits... 2019-12-19T22:09:13.072 INFO:teuthology.orchestra.run.smithi050:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2019-12-19T22:09:13.105 INFO:teuthology.orchestra.run.smithi050:> sudo lsb_release -is 2019-12-19T22:09:13.185 INFO:teuthology.orchestra.run.smithi050.stdout:RedHatEnterprise 2019-12-19T22:09:13.188 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2019-12-19T22:09:13.188 INFO:teuthology.task.install.rpm:Removing packages: ceph-radosgw, ceph-test, ceph, cephadm, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-cloud, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse on rpm system. 2019-12-19T22:09:13.188 INFO:teuthology.orchestra.run.smithi050:> 2019-12-19T22:09:13.188 INFO:teuthology.orchestra.run.smithi050:> for d in ceph-radosgw ceph-test ceph cephadm ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-cloud ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse ; do 2019-12-19T22:09:13.188 INFO:teuthology.orchestra.run.smithi050:> sudo yum -y remove $d || true 2019-12-19T22:09:13.188 INFO:teuthology.orchestra.run.smithi050:> done 2019-12-19T22:09:13.602 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2019-12-19T22:09:14.856 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2019-12-19T22:09:14.857 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:09:14.857 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2019-12-19T22:09:14.857 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:09:14.857 INFO:teuthology.orchestra.run.smithi050.stdout:Removing: 2019-12-19T22:09:14.857 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-radosgw x86_64 2:15.0.0-8663.g368c5a4.el8 @ceph 27 M 2019-12-19T22:09:14.858 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:09:14.858 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2019-12-19T22:09:14.858 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:09:14.858 INFO:teuthology.orchestra.run.smithi050.stdout:Remove 1 Package 2019-12-19T22:09:14.858 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:09:14.858 INFO:teuthology.orchestra.run.smithi050.stdout:Freed space: 27 M 2019-12-19T22:09:14.859 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2019-12-19T22:09:14.860 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2019-12-19T22:09:14.861 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2019-12-19T22:09:14.889 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2019-12-19T22:09:14.889 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2019-12-19T22:09:14.945 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2019-12-19T22:09:14.977 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-radosgw-2:15.0.0-8663.g368c5a4.el8.x86_64 1/1 2019-12-19T22:09:14.978 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : ceph-radosgw-2:15.0.0-8663.g368c5a4.el8.x86_64 1/1 2019-12-19T22:09:15.409 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-radosgw-2:15.0.0-8663.g368c5a4.el8.x86_64 1/1 2019-12-19T22:09:15.773 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-radosgw-2:15.0.0-8663.g368c5a4.el8.x86_64 1/1 2019-12-19T22:09:15.805 INFO:teuthology.orchestra.run.smithi050.stdout:Installed products updated. 2019-12-19T22:09:16.315 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2019-12-19T22:09:18.553 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:09:18.553 INFO:teuthology.orchestra.run.smithi050.stdout:Removed: 2019-12-19T22:09:18.553 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-radosgw-2:15.0.0-8663.g368c5a4.el8.x86_64 2019-12-19T22:09:18.553 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:09:18.553 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2019-12-19T22:09:19.107 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2019-12-19T22:09:19.725 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2019-12-19T22:09:19.726 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:09:19.727 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2019-12-19T22:09:19.727 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:09:19.727 INFO:teuthology.orchestra.run.smithi050.stdout:Removing: 2019-12-19T22:09:19.727 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-test x86_64 2:15.0.0-8663.g368c5a4.el8 2019-12-19T22:09:19.728 INFO:teuthology.orchestra.run.smithi050.stdout: @ceph 147 M 2019-12-19T22:09:19.728 INFO:teuthology.orchestra.run.smithi050.stdout:Removing unused dependencies: 2019-12-19T22:09:19.728 INFO:teuthology.orchestra.run.smithi050.stdout: jq x86_64 1.5-12.el8 @rhel-8-for-x86_64-appstream-rpms 357 k 2019-12-19T22:09:19.728 INFO:teuthology.orchestra.run.smithi050.stdout: oniguruma x86_64 6.8.2-1.el8 @rhel-8-for-x86_64-appstream-rpms 692 k 2019-12-19T22:09:19.729 INFO:teuthology.orchestra.run.smithi050.stdout: socat x86_64 1.7.3.2-6.el8 @rhel-8-for-x86_64-appstream-rpms 1.1 M 2019-12-19T22:09:19.729 INFO:teuthology.orchestra.run.smithi050.stdout: xmlstarlet x86_64 1.6.1-13.el8 @lab-extras 211 k 2019-12-19T22:09:19.729 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:09:19.729 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2019-12-19T22:09:19.730 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:09:19.730 INFO:teuthology.orchestra.run.smithi050.stdout:Remove 5 Packages 2019-12-19T22:09:19.730 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:09:19.730 INFO:teuthology.orchestra.run.smithi050.stdout:Freed space: 149 M 2019-12-19T22:09:19.731 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2019-12-19T22:09:19.732 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2019-12-19T22:09:19.733 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2019-12-19T22:09:19.775 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2019-12-19T22:09:19.775 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2019-12-19T22:09:19.907 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2019-12-19T22:09:20.072 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : ceph-test-2:15.0.0-8663.g368c5a4.el8.x86_64 1/5 2019-12-19T22:09:20.221 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : jq-1.5-12.el8.x86_64 2/5 2019-12-19T22:09:20.222 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : oniguruma-6.8.2-1.el8.x86_64 3/5 2019-12-19T22:09:20.448 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: oniguruma-6.8.2-1.el8.x86_64 3/5 2019-12-19T22:09:20.613 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : socat-1.7.3.2-6.el8.x86_64 4/5 2019-12-19T22:09:20.724 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : xmlstarlet-1.6.1-13.el8.x86_64 5/5 2019-12-19T22:09:20.921 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: xmlstarlet-1.6.1-13.el8.x86_64 5/5 2019-12-19T22:09:20.921 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-test-2:15.0.0-8663.g368c5a4.el8.x86_64 1/5 2019-12-19T22:09:20.921 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : jq-1.5-12.el8.x86_64 2/5 2019-12-19T22:09:20.922 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : oniguruma-6.8.2-1.el8.x86_64 3/5 2019-12-19T22:09:20.922 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : socat-1.7.3.2-6.el8.x86_64 4/5 2019-12-19T22:09:21.289 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xmlstarlet-1.6.1-13.el8.x86_64 5/5 2019-12-19T22:09:21.289 INFO:teuthology.orchestra.run.smithi050.stdout:Installed products updated. 2019-12-19T22:09:24.023 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:09:24.023 INFO:teuthology.orchestra.run.smithi050.stdout:Removed: 2019-12-19T22:09:24.023 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-test-2:15.0.0-8663.g368c5a4.el8.x86_64 jq-1.5-12.el8.x86_64 2019-12-19T22:09:24.023 INFO:teuthology.orchestra.run.smithi050.stdout: oniguruma-6.8.2-1.el8.x86_64 socat-1.7.3.2-6.el8.x86_64 2019-12-19T22:09:24.024 INFO:teuthology.orchestra.run.smithi050.stdout: xmlstarlet-1.6.1-13.el8.x86_64 2019-12-19T22:09:24.024 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:09:24.024 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2019-12-19T22:09:24.574 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2019-12-19T22:09:25.289 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2019-12-19T22:09:25.291 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:09:25.291 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2019-12-19T22:09:25.291 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:09:25.291 INFO:teuthology.orchestra.run.smithi050.stdout:Removing: 2019-12-19T22:09:25.291 INFO:teuthology.orchestra.run.smithi050.stdout: ceph x86_64 2:15.0.0-8663.g368c5a4.el8 @ceph 0 2019-12-19T22:09:25.292 INFO:teuthology.orchestra.run.smithi050.stdout:Removing unused dependencies: 2019-12-19T22:09:25.292 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mds x86_64 2:15.0.0-8663.g368c5a4.el8 @ceph 7.1 M 2019-12-19T22:09:25.292 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mon x86_64 2:15.0.0-8663.g368c5a4.el8 @ceph 15 M 2019-12-19T22:09:25.292 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-osd x86_64 2:15.0.0-8663.g368c5a4.el8 @ceph 58 M 2019-12-19T22:09:25.292 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:09:25.292 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2019-12-19T22:09:25.292 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:09:25.293 INFO:teuthology.orchestra.run.smithi050.stdout:Remove 4 Packages 2019-12-19T22:09:25.293 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:09:25.293 INFO:teuthology.orchestra.run.smithi050.stdout:Freed space: 80 M 2019-12-19T22:09:25.293 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2019-12-19T22:09:25.295 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2019-12-19T22:09:25.295 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2019-12-19T22:09:25.323 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2019-12-19T22:09:25.323 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2019-12-19T22:09:25.411 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2019-12-19T22:09:25.418 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-2:15.0.0-8663.g368c5a4.el8.x86_64 1/1 2019-12-19T22:09:25.487 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : ceph-2:15.0.0-8663.g368c5a4.el8.x86_64 1/4 2019-12-19T22:09:25.513 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mds-2:15.0.0-8663.g368c5a4.el8.x86_64 2/4 2019-12-19T22:09:25.513 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : ceph-mds-2:15.0.0-8663.g368c5a4.el8.x86_64 2/4 2019-12-19T22:09:25.712 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mds-2:15.0.0-8663.g368c5a4.el8.x86_64 2/4 2019-12-19T22:09:25.737 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mon-2:15.0.0-8663.g368c5a4.el8.x86_64 3/4 2019-12-19T22:09:25.737 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : ceph-mon-2:15.0.0-8663.g368c5a4.el8.x86_64 3/4 2019-12-19T22:09:25.854 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mon-2:15.0.0-8663.g368c5a4.el8.x86_64 3/4 2019-12-19T22:09:25.882 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-osd-2:15.0.0-8663.g368c5a4.el8.x86_64 4/4 2019-12-19T22:09:25.883 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : ceph-osd-2:15.0.0-8663.g368c5a4.el8.x86_64 4/4 2019-12-19T22:09:26.219 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-osd-2:15.0.0-8663.g368c5a4.el8.x86_64 4/4 2019-12-19T22:09:26.219 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-2:15.0.0-8663.g368c5a4.el8.x86_64 1/4 2019-12-19T22:09:26.219 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mds-2:15.0.0-8663.g368c5a4.el8.x86_64 2/4 2019-12-19T22:09:26.219 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mon-2:15.0.0-8663.g368c5a4.el8.x86_64 3/4 2019-12-19T22:09:26.633 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-osd-2:15.0.0-8663.g368c5a4.el8.x86_64 4/4 2019-12-19T22:09:26.633 INFO:teuthology.orchestra.run.smithi050.stdout:Installed products updated. 2019-12-19T22:09:29.376 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:09:29.376 INFO:teuthology.orchestra.run.smithi050.stdout:Removed: 2019-12-19T22:09:29.377 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-2:15.0.0-8663.g368c5a4.el8.x86_64 2019-12-19T22:09:29.377 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mds-2:15.0.0-8663.g368c5a4.el8.x86_64 2019-12-19T22:09:29.377 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mon-2:15.0.0-8663.g368c5a4.el8.x86_64 2019-12-19T22:09:29.377 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-osd-2:15.0.0-8663.g368c5a4.el8.x86_64 2019-12-19T22:09:29.377 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:09:29.377 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2019-12-19T22:09:29.941 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2019-12-19T22:09:30.732 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2019-12-19T22:09:30.734 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:09:30.734 INFO:teuthology.orchestra.run.smithi050.stdout: Package ArchVersion Repository Size 2019-12-19T22:09:30.734 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:09:30.734 INFO:teuthology.orchestra.run.smithi050.stdout:Removing: 2019-12-19T22:09:30.735 INFO:teuthology.orchestra.run.smithi050.stdout: cephadm x86_642:15.0.0-8663.g368c5a4.el8 @ceph 82 k 2019-12-19T22:09:30.735 INFO:teuthology.orchestra.run.smithi050.stdout:Removing dependent packages: 2019-12-19T22:09:30.735 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-cephadm noarch2:15.0.0-8663.g368c5a4.el8 @ceph-noarch 70 k 2019-12-19T22:09:30.735 INFO:teuthology.orchestra.run.smithi050.stdout:Removing unused dependencies: 2019-12-19T22:09:30.736 INFO:teuthology.orchestra.run.smithi050.stdout: python3-apipkg noarch1.5-2.el8 @epel 24 k 2019-12-19T22:09:30.736 INFO:teuthology.orchestra.run.smithi050.stdout: python3-execnet noarch1.7.1-1.el8.2 @copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 1.2 M 2019-12-19T22:09:30.736 INFO:teuthology.orchestra.run.smithi050.stdout: python3-remoto noarch1.1.4-4.el8 @copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 97 k 2019-12-19T22:09:30.736 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:09:30.736 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2019-12-19T22:09:30.737 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:09:30.737 INFO:teuthology.orchestra.run.smithi050.stdout:Remove 5 Packages 2019-12-19T22:09:30.737 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:09:30.738 INFO:teuthology.orchestra.run.smithi050.stdout:Freed space: 1.4 M 2019-12-19T22:09:30.740 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2019-12-19T22:09:30.740 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2019-12-19T22:09:30.740 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2019-12-19T22:09:30.760 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2019-12-19T22:09:30.760 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2019-12-19T22:09:30.853 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2019-12-19T22:09:30.853 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : ceph-mgr-cephadm-2:15.0.0-8663.g368c5a4.el8.noarch 1/5 2019-12-19T22:09:30.973 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-cephadm-2:15.0.0-8663.g368c5a4.el8.noarch 1/5 2019-12-19T22:09:31.134 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-remoto-1.1.4-4.el8.noarch 2/5 2019-12-19T22:09:31.278 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-execnet-1.7.1-1.el8.2.noarch 3/5 2019-12-19T22:09:31.404 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-apipkg-1.5-2.el8.noarch 4/5 2019-12-19T22:09:31.405 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : cephadm-2:15.0.0-8663.g368c5a4.el8.x86_64 5/5 2019-12-19T22:09:32.230 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: cephadm-2:15.0.0-8663.g368c5a4.el8.x86_64 5/5 2019-12-19T22:09:32.231 INFO:teuthology.orchestra.run.smithi050.stdout:userdel: cephadm mail spool (/var/spool/mail/cephadm) not found 2019-12-19T22:09:32.231 INFO:teuthology.orchestra.run.smithi050.stdout:userdel: cephadm home directory (/var/lib/cephadm) not found 2019-12-19T22:09:32.231 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:09:32.530 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-cephadm-2:15.0.0-8663.g368c5a4.el8.noarch 1/5 2019-12-19T22:09:32.530 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephadm-2:15.0.0-8663.g368c5a4.el8.x86_64 2/5 2019-12-19T22:09:32.530 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-apipkg-1.5-2.el8.noarch 3/5 2019-12-19T22:09:32.530 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-execnet-1.7.1-1.el8.2.noarch 4/5 2019-12-19T22:09:32.903 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 5/5 2019-12-19T22:09:32.903 INFO:teuthology.orchestra.run.smithi050.stdout:Installed products updated. 2019-12-19T22:09:40.507 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:09:40.507 INFO:teuthology.orchestra.run.smithi050.stdout:Removed: 2019-12-19T22:09:40.507 INFO:teuthology.orchestra.run.smithi050.stdout: cephadm-2:15.0.0-8663.g368c5a4.el8.x86_64 2019-12-19T22:09:40.507 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-cephadm-2:15.0.0-8663.g368c5a4.el8.noarch 2019-12-19T22:09:40.508 INFO:teuthology.orchestra.run.smithi050.stdout: python3-apipkg-1.5-2.el8.noarch 2019-12-19T22:09:40.508 INFO:teuthology.orchestra.run.smithi050.stdout: python3-execnet-1.7.1-1.el8.2.noarch 2019-12-19T22:09:40.508 INFO:teuthology.orchestra.run.smithi050.stdout: python3-remoto-1.1.4-4.el8.noarch 2019-12-19T22:09:40.508 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:09:40.508 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2019-12-19T22:09:41.075 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2019-12-19T22:09:41.711 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2019-12-19T22:09:41.725 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:09:41.725 INFO:teuthology.orchestra.run.smithi050.stdout: Package ArchVersion Repository Size 2019-12-19T22:09:41.725 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:09:41.726 INFO:teuthology.orchestra.run.smithi050.stdout:Removing: 2019-12-19T22:09:41.726 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr x86_642:15.0.0-8663.g368c5a4.el8 @ceph 5.9 M 2019-12-19T22:09:41.726 INFO:teuthology.orchestra.run.smithi050.stdout:Removing dependent packages: 2019-12-19T22:09:41.726 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard noarch2:15.0.0-8663.g368c5a4.el8 @ceph-noarch 17 M 2019-12-19T22:09:41.726 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-diskprediction-cloud noarch2:15.0.0-8663.g368c5a4.el8 @ceph-noarch 212 k 2019-12-19T22:09:41.726 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-diskprediction-local noarch2:15.0.0-8663.g368c5a4.el8 @ceph-noarch 66 M 2019-12-19T22:09:41.726 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-rook noarch2:15.0.0-8663.g368c5a4.el8 @ceph-noarch 35 k 2019-12-19T22:09:41.727 INFO:teuthology.orchestra.run.smithi050.stdout:Removing unused dependencies: 2019-12-19T22:09:41.727 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base x86_642:15.0.0-8663.g368c5a4.el8 @ceph 25 M 2019-12-19T22:09:41.727 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-common x86_642:15.0.0-8663.g368c5a4.el8 @ceph 76 M 2019-12-19T22:09:41.727 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-grafana-dashboards noarch2:15.0.0-8663.g368c5a4.el8 @ceph-noarch 201 k 2019-12-19T22:09:41.727 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-selinux x86_642:15.0.0-8663.g368c5a4.el8 @ceph 130 k 2019-12-19T22:09:41.727 INFO:teuthology.orchestra.run.smithi050.stdout: gperftools-libs x86_642.7-6.el8 @epel 1.7 M 2019-12-19T22:09:41.727 INFO:teuthology.orchestra.run.smithi050.stdout: leveldb x86_641.21-2.el8 @lab-extras 482 k 2019-12-19T22:09:41.728 INFO:teuthology.orchestra.run.smithi050.stdout: libbabeltrace x86_641.5.6-2.el8 @lab-extras 566 k 2019-12-19T22:09:41.728 INFO:teuthology.orchestra.run.smithi050.stdout: libgfortran x86_648.2.1-3.5.el8 @rhel-8-for-x86_64-baseos-rpms 2.5 M 2019-12-19T22:09:41.728 INFO:teuthology.orchestra.run.smithi050.stdout: liboath x86_642.6.2-3.el8 @epel 125 k 2019-12-19T22:09:41.728 INFO:teuthology.orchestra.run.smithi050.stdout: libquadmath x86_648.2.1-3.5.el8 @rhel-8-for-x86_64-baseos-rpms 299 k 2019-12-19T22:09:41.728 INFO:teuthology.orchestra.run.smithi050.stdout: librabbitmq x86_640.9.0-1.el8 @rhel-8-for-x86_64-baseos-rpms 95 k 2019-12-19T22:09:41.729 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1 x86_642:15.0.0-8663.g368c5a4.el8 @ceph 1.4 M 2019-12-19T22:09:41.729 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka x86_640.11.4-1.el8 @rhel-8-for-x86_64-appstream-rpms 1.1 M 2019-12-19T22:09:41.729 INFO:teuthology.orchestra.run.smithi050.stdout: librgw2 x86_642:15.0.0-8663.g368c5a4.el8 @ceph 24 M 2019-12-19T22:09:41.729 INFO:teuthology.orchestra.run.smithi050.stdout: libunwind x86_641.3.1-3.el8 @epel 205 k 2019-12-19T22:09:41.729 INFO:teuthology.orchestra.run.smithi050.stdout: libxslt x86_641.1.32-3.el8 @rhel-8-for-x86_64-baseos-rpms 743 k 2019-12-19T22:09:41.729 INFO:teuthology.orchestra.run.smithi050.stdout: openblas x86_640.3.3-2.el8 @rhel-8-for-x86_64-appstream-rpms 31 M 2019-12-19T22:09:41.730 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-threads x86_640.3.3-2.el8 @rhel-8-for-x86_64-appstream-rpms 32 M 2019-12-19T22:09:41.730 INFO:teuthology.orchestra.run.smithi050.stdout: python3-bcrypt x86_643.1.6-2.el8.1 @epel 78 k 2019-12-19T22:09:41.730 INFO:teuthology.orchestra.run.smithi050.stdout: python3-beautifulsoup4 noarch4.6.3-2.el8.1 @epel 817 k 2019-12-19T22:09:41.730 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cachetools noarch3.1.1-4.el8 @epel 71 k 2019-12-19T22:09:41.730 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse x86_642:15.0.0-8663.g368c5a4.el8 @ceph 112 k 2019-12-19T22:09:41.730 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common x86_642:15.0.0-8663.g368c5a4.el8 @ceph 146 k 2019-12-19T22:09:41.730 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cephfs x86_642:15.0.0-8663.g368c5a4.el8 @ceph 468 k 2019-12-19T22:09:41.731 INFO:teuthology.orchestra.run.smithi050.stdout: python3-certifi noarch2018.10.15-7.el8 @epel 8.2 k 2019-12-19T22:09:41.731 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cheroot noarch8.2.1-1.el8 @copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 531 k 2019-12-19T22:09:41.731 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy noarch18.4.0-1.el8 @copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 1.1 M 2019-12-19T22:09:41.731 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cssselect noarch0.9.2-10.el8 @epel 142 k 2019-12-19T22:09:41.731 INFO:teuthology.orchestra.run.smithi050.stdout: python3-google-auth noarch1:1.1.1-10.el8 @epel 306 k 2019-12-19T22:09:41.731 INFO:teuthology.orchestra.run.smithi050.stdout: python3-html5lib noarch1:0.999999999-6.el8 @rhel-8-for-x86_64-appstream-rpms 1.1 M 2019-12-19T22:09:41.731 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco noarch6.2-6.el8 @copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 4.0 k 2019-12-19T22:09:41.732 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-functools noarch2.0-4.el8 @copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 28 k 2019-12-19T22:09:41.732 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jwt noarch1.6.1-2.el8 @rhel-8-for-x86_64-baseos-rpms 88 k 2019-12-19T22:09:41.732 INFO:teuthology.orchestra.run.smithi050.stdout: python3-kubernetes noarch10.0.1-1.el8 @epel 20 M 2019-12-19T22:09:41.732 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils noarch0.3.5-11.el8 @copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 126 k 2019-12-19T22:09:41.732 INFO:teuthology.orchestra.run.smithi050.stdout: python3-lxml x86_644.2.3-1.el8 @rhel-8-for-x86_64-appstream-rpms 4.8 M 2019-12-19T22:09:41.732 INFO:teuthology.orchestra.run.smithi050.stdout: python3-mako noarch1.0.6-13.el8 @rhel-8-for-x86_64-appstream-rpms 540 k 2019-12-19T22:09:41.732 INFO:teuthology.orchestra.run.smithi050.stdout: python3-markupsafe x86_640.23-19.el8 @rhel-8-for-x86_64-appstream-rpms 76 k 2019-12-19T22:09:41.733 INFO:teuthology.orchestra.run.smithi050.stdout: python3-more-itertools noarch7.2.0-3.el8 @copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 302 k 2019-12-19T22:09:41.733 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy x86_641:1.14.3-6.el8 @rhel-8-for-x86_64-appstream-rpms 16 M 2019-12-19T22:09:41.733 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-f2py x86_641:1.14.3-6.el8 @rhel-8-for-x86_64-appstream-rpms 946 k 2019-12-19T22:09:41.733 INFO:teuthology.orchestra.run.smithi050.stdout: python3-oauthlib noarch2.1.0-1.el8 @rhel-8-for-x86_64-baseos-rpms 737 k 2019-12-19T22:09:41.733 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan noarch1.3.2-9.el8 @copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 1.3 M 2019-12-19T22:09:41.733 INFO:teuthology.orchestra.run.smithi050.stdout: python3-portend noarch2.6-1.el8 @copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 19 k 2019-12-19T22:09:41.733 INFO:teuthology.orchestra.run.smithi050.stdout: python3-prettytable noarch0.7.2-14.el8 @rhel-8-for-x86_64-appstream-rpms 167 k 2019-12-19T22:09:41.734 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1 noarch0.3.7-6.el8 @rhel-8-for-x86_64-appstream-rpms 522 k 2019-12-19T22:09:41.734 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-modules noarch0.3.7-6.el8 @rhel-8-for-x86_64-appstream-rpms 603 k 2019-12-19T22:09:41.734 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytz noarch2017.2-9.el8 @rhel-8-for-x86_64-appstream-rpms 175 k 2019-12-19T22:09:41.734 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rados x86_642:15.0.0-8663.g368c5a4.el8 @ceph 1.1 M 2019-12-19T22:09:41.734 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rbd x86_642:15.0.0-8663.g368c5a4.el8 @ceph 1.0 M 2019-12-19T22:09:41.734 INFO:teuthology.orchestra.run.smithi050.stdout: python3-repoze-lru noarch0.7-6.el8 @copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 84 k 2019-12-19T22:09:41.734 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-oauthlib noarch1.0.0-1.el8 @rhel-8-for-x86_64-baseos-rpms 107 k 2019-12-19T22:09:41.735 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rgw x86_642:15.0.0-8663.g368c5a4.el8 @ceph 293 k 2019-12-19T22:09:41.735 INFO:teuthology.orchestra.run.smithi050.stdout: python3-routes noarch2.4.1-12.el8 @copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 454 k 2019-12-19T22:09:41.735 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rsa noarch3.4.2-12.el8 @epel 240 k 2019-12-19T22:09:41.735 INFO:teuthology.orchestra.run.smithi050.stdout: python3-scipy x86_641.0.0-19.module+el8.0.0+2966+d39a1df3 @rhel-8-for-x86_64-appstream-rpms 55 M 2019-12-19T22:09:41.735 INFO:teuthology.orchestra.run.smithi050.stdout: python3-simplegeneric noarch0.8.1-17.el8 @copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 24 k 2019-12-19T22:09:41.735 INFO:teuthology.orchestra.run.smithi050.stdout: python3-singledispatch noarch3.4.0.3-18.el8 @copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 43 k 2019-12-19T22:09:41.735 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempora noarch1.14.1-5.el8 @copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 82 k 2019-12-19T22:09:41.736 INFO:teuthology.orchestra.run.smithi050.stdout: python3-trustme noarch0.5.2-4.el8 @copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 51 k 2019-12-19T22:09:41.736 INFO:teuthology.orchestra.run.smithi050.stdout: python3-waitress noarch1.2.1-2.el8.1 @epel 1.0 M 2019-12-19T22:09:41.736 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webencodings noarch0.5.1-6.el8 @rhel-8-for-x86_64-appstream-rpms 72 k 2019-12-19T22:09:41.736 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob noarch1.8.5-1.el8.1 @epel 1.2 M 2019-12-19T22:09:41.736 INFO:teuthology.orchestra.run.smithi050.stdout: python3-websocket-client noarch0.56.0-5.el8 @epel 180 k 2019-12-19T22:09:41.736 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webtest noarch2.0.33-1.el8 @epel 289 k 2019-12-19T22:09:41.736 INFO:teuthology.orchestra.run.smithi050.stdout: python3-werkzeug noarch0.12.2-4.el8 @rhel-8-for-x86_64-appstream-rpms 2.0 M 2019-12-19T22:09:41.737 INFO:teuthology.orchestra.run.smithi050.stdout: python3-zc-lockfile noarch2.0-2.el8 @copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 35 k 2019-12-19T22:09:41.737 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:09:41.737 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2019-12-19T22:09:41.737 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:09:41.737 INFO:teuthology.orchestra.run.smithi050.stdout:Remove 72 Packages 2019-12-19T22:09:41.737 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:09:41.738 INFO:teuthology.orchestra.run.smithi050.stdout:Freed space: 401 M 2019-12-19T22:09:41.738 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2019-12-19T22:09:41.762 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2019-12-19T22:09:41.762 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2019-12-19T22:09:41.843 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2019-12-19T22:09:41.843 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2019-12-19T22:09:42.559 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2019-12-19T22:09:42.647 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-dashboard-2:15.0.0-8663.g368c5a4.el8.noarch 1/1 2019-12-19T22:09:42.648 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : ceph-mgr-dashboard-2:15.0.0-8663.g368c5a4.el8.noar 1/72 2019-12-19T22:09:42.804 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-dashboard-2:15.0.0-8663.g368c5a4.el8.noar 1/72 2019-12-19T22:09:42.804 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : ceph-mgr-diskprediction-local-2:15.0.0-8663.g368c5 2/72 2019-12-19T22:09:43.033 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:15.0.0-8663.g368c5 2/72 2019-12-19T22:09:43.285 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-scipy-1.0.0-19.module+el8.0.0+2966+d39a1df 3/72 2019-12-19T22:09:43.285 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : ceph-mgr-rook-2:15.0.0-8663.g368c5a4.el8.noarch 4/72 2019-12-19T22:09:43.490 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-rook-2:15.0.0-8663.g368c5a4.el8.noarch 4/72 2019-12-19T22:09:43.648 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-kubernetes-10.0.1-1.el8.noarch 5/72 2019-12-19T22:09:43.788 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-google-auth-1:1.1.1-10.el8.noarch 6/72 2019-12-19T22:09:43.905 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-pyasn1-modules-0.3.7-6.el8.noarch 7/72 2019-12-19T22:09:44.048 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-rsa-3.4.2-12.el8.noarch 8/72 2019-12-19T22:09:44.192 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/72 2019-12-19T22:09:44.342 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-oauthlib-2.1.0-1.el8.noarch 10/72 2019-12-19T22:09:44.342 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-numpy-f2py-1:1.14.3-6.el8.x86_64 11/72 2019-12-19T22:09:44.538 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-6.el8.x86_64 11/72 2019-12-19T22:09:44.669 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-routes-2.4.1-12.el8.noarch 12/72 2019-12-19T22:09:44.670 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : ceph-mgr-diskprediction-cloud-2:15.0.0-8663.g368c5 13/72 2019-12-19T22:09:44.795 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-diskprediction-cloud-2:15.0.0-8663.g368c5 13/72 2019-12-19T22:09:44.921 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-repoze-lru-0.7-6.el8.noarch 14/72 2019-12-19T22:09:45.059 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-jwt-1.6.1-2.el8.noarch 15/72 2019-12-19T22:09:45.188 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-pyasn1-0.3.7-6.el8.noarch 16/72 2019-12-19T22:09:45.353 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-cachetools-3.1.1-4.el8.noarch 17/72 2019-12-19T22:09:45.479 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-certifi-2018.10.15-7.el8.noarch 18/72 2019-12-19T22:09:45.644 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-websocket-client-0.56.0-5.el8.noarch 19/72 2019-12-19T22:09:45.785 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : ceph-grafana-dashboards-2:15.0.0-8663.g368c5a4.el8 20/72 2019-12-19T22:09:45.816 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-2:15.0.0-8663.g368c5a4.el8.x86_64 21/72 2019-12-19T22:09:45.817 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : ceph-mgr-2:15.0.0-8663.g368c5a4.el8.x86_64 21/72 2019-12-19T22:09:46.082 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-2:15.0.0-8663.g368c5a4.el8.x86_64 21/72 2019-12-19T22:09:46.301 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-pecan-1.3.2-9.el8.noarch 22/72 2019-12-19T22:09:46.435 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-cherrypy-18.4.0-1.el8.noarch 23/72 2019-12-19T22:09:46.473 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-base-2:15.0.0-8663.g368c5a4.el8.x86_64 24/72 2019-12-19T22:09:46.479 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : ceph-base-2:15.0.0-8663.g368c5a4.el8.x86_64 24/72 2019-12-19T22:09:46.479 INFO:teuthology.orchestra.run.smithi050.stdout:warning: file /etc/logrotate.d/ceph: remove failed: No such file or directory 2019-12-19T22:09:46.479 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:09:46.757 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-base-2:15.0.0-8663.g368c5a4.el8.x86_64 24/72 2019-12-19T22:09:46.895 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-cheroot-8.2.1-1.el8.noarch 25/72 2019-12-19T22:09:47.080 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-webtest-2.0.33-1.el8.noarch 26/72 2019-12-19T22:09:47.080 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : ceph-common-2:15.0.0-8663.g368c5a4.el8.x86_64 27/72 2019-12-19T22:09:47.080 INFO:teuthology.orchestra.run.smithi050.stdout:warning: directory /var/lib/ceph: remove failed: Device or resource busy 2019-12-19T22:09:47.080 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:09:47.277 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-common-2:15.0.0-8663.g368c5a4.el8.x86_64 27/72 2019-12-19T22:09:47.445 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-rgw-2:15.0.0-8663.g368c5a4.el8.x86_64 28/72 2019-12-19T22:09:47.446 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : librgw2-2:15.0.0-8663.g368c5a4.el8.x86_64 29/72 2019-12-19T22:09:47.660 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librgw2-2:15.0.0-8663.g368c5a4.el8.x86_64 29/72 2019-12-19T22:09:47.852 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-cephfs-2:15.0.0-8663.g368c5a4.el8.x86_64 30/72 2019-12-19T22:09:48.071 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-numpy-1:1.14.3-6.el8.x86_64 31/72 2019-12-19T22:09:48.276 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 32/72 2019-12-19T22:09:48.419 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-portend-2.6-1.el8.noarch 33/72 2019-12-19T22:09:48.568 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-tempora-1.14.1-5.el8.noarch 34/72 2019-12-19T22:09:48.709 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-jaraco-functools-2.0-4.el8.noarch 35/72 2019-12-19T22:09:48.887 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-mako-1.0.6-13.el8.noarch 36/72 2019-12-19T22:09:48.988 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-jaraco-6.2-6.el8.noarch 37/72 2019-12-19T22:09:49.104 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-pytz-2017.2-9.el8.noarch 38/72 2019-12-19T22:09:49.204 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-ceph-argparse-2:15.0.0-8663.g368c5a4.el8.x 39/72 2019-12-19T22:09:49.343 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-ceph-common-2:15.0.0-8663.g368c5a4.el8.x86 40/72 2019-12-19T22:09:49.476 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-prettytable-0.7.2-14.el8.noarch 41/72 2019-12-19T22:09:49.632 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-waitress-1.2.1-2.el8.1.noarch 42/72 2019-12-19T22:09:49.819 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-webob-1.8.5-1.el8.1.noarch 43/72 2019-12-19T22:09:49.952 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-more-itertools-7.2.0-3.el8.noarch 44/72 2019-12-19T22:09:50.101 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-trustme-0.5.2-4.el8.noarch 45/72 2019-12-19T22:09:50.101 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : ceph-selinux-2:15.0.0-8663.g368c5a4.el8.x86_64 46/72 2019-12-19T22:10:05.282 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-selinux-2:15.0.0-8663.g368c5a4.el8.x86_64 46/72 2019-12-19T22:10:05.282 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /sys 2019-12-19T22:10:05.282 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /proc 2019-12-19T22:10:05.283 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /dev 2019-12-19T22:10:05.283 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /run 2019-12-19T22:10:05.283 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /mnt 2019-12-19T22:10:05.283 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /var/tmp 2019-12-19T22:10:05.283 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /home 2019-12-19T22:10:05.283 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /tmp 2019-12-19T22:10:05.283 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /dev 2019-12-19T22:10:05.283 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:10:05.550 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-zc-lockfile-2.0-2.el8.noarch 47/72 2019-12-19T22:10:05.690 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-logutils-0.3.5-11.el8.noarch 48/72 2019-12-19T22:10:05.808 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-simplegeneric-0.8.1-17.el8.noarch 49/72 2019-12-19T22:10:05.974 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-singledispatch-3.4.0.3-18.el8.noarch 50/72 2019-12-19T22:10:06.140 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-werkzeug-0.12.2-4.el8.noarch 51/72 2019-12-19T22:10:06.318 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-lxml-4.2.3-1.el8.x86_64 52/72 2019-12-19T22:10:06.318 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : openblas-0.3.3-2.el8.x86_64 53/72 2019-12-19T22:10:06.510 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: openblas-0.3.3-2.el8.x86_64 53/72 2019-12-19T22:10:06.510 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : openblas-threads-0.3.3-2.el8.x86_64 54/72 2019-12-19T22:10:06.680 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: openblas-threads-0.3.3-2.el8.x86_64 54/72 2019-12-19T22:10:06.857 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-html5lib-1:0.999999999-6.el8.noarch 55/72 2019-12-19T22:10:06.857 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : libgfortran-8.2.1-3.5.el8.x86_64 56/72 2019-12-19T22:10:07.041 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libgfortran-8.2.1-3.5.el8.x86_64 56/72 2019-12-19T22:10:07.166 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : leveldb-1.21-2.el8.x86_64 57/72 2019-12-19T22:10:07.323 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : gperftools-libs-2.7-6.el8.x86_64 58/72 2019-12-19T22:10:07.475 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-rbd-2:15.0.0-8663.g368c5a4.el8.x86_64 59/72 2019-12-19T22:10:07.608 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-webencodings-0.5.1-6.el8.noarch 60/72 2019-12-19T22:10:07.782 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-cssselect-0.9.2-10.el8.noarch 61/72 2019-12-19T22:10:07.942 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-rados-2:15.0.0-8663.g368c5a4.el8.x86_64 62/72 2019-12-19T22:10:08.073 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : libunwind-1.3.1-3.el8.x86_64 63/72 2019-12-19T22:10:08.084 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libquadmath-8.2.1-3.5.el8.x86_64 64/72 2019-12-19T22:10:08.085 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : libquadmath-8.2.1-3.5.el8.x86_64 64/72 2019-12-19T22:10:08.267 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libquadmath-8.2.1-3.5.el8.x86_64 64/72 2019-12-19T22:10:08.399 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : libxslt-1.1.32-3.el8.x86_64 65/72 2019-12-19T22:10:08.567 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-markupsafe-0.23-19.el8.x86_64 66/72 2019-12-19T22:10:08.698 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : liboath-2.6.2-3.el8.x86_64 67/72 2019-12-19T22:10:08.824 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : librabbitmq-0.9.0-1.el8.x86_64 68/72 2019-12-19T22:10:08.824 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : librdkafka-0.11.4-1.el8.x86_64 69/72 2019-12-19T22:10:09.044 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 69/72 2019-12-19T22:10:09.182 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : libbabeltrace-1.5.6-2.el8.x86_64 70/72 2019-12-19T22:10:09.182 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : libradosstriper1-2:15.0.0-8663.g368c5a4.el8.x86_64 71/72 2019-12-19T22:10:09.367 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libradosstriper1-2:15.0.0-8663.g368c5a4.el8.x86_64 71/72 2019-12-19T22:10:09.574 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : python3-bcrypt-3.1.6-2.el8.1.x86_64 72/72 2019-12-19T22:10:09.780 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: python3-bcrypt-3.1.6-2.el8.1.x86_64 72/72 2019-12-19T22:10:09.780 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-base-2:15.0.0-8663.g368c5a4.el8.x86_64 1/72 2019-12-19T22:10:09.781 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-common-2:15.0.0-8663.g368c5a4.el8.x86_64 2/72 2019-12-19T22:10:09.781 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-grafana-dashboards-2:15.0.0-8663.g368c5a4.el8 3/72 2019-12-19T22:10:09.781 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-2:15.0.0-8663.g368c5a4.el8.x86_64 4/72 2019-12-19T22:10:09.781 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-dashboard-2:15.0.0-8663.g368c5a4.el8.noar 5/72 2019-12-19T22:10:09.781 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-diskprediction-cloud-2:15.0.0-8663.g368c5 6/72 2019-12-19T22:10:09.781 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-diskprediction-local-2:15.0.0-8663.g368c5 7/72 2019-12-19T22:10:09.781 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-rook-2:15.0.0-8663.g368c5a4.el8.noarch 8/72 2019-12-19T22:10:09.782 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-selinux-2:15.0.0-8663.g368c5a4.el8.x86_64 9/72 2019-12-19T22:10:09.787 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 10/72 2019-12-19T22:10:09.787 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : leveldb-1.21-2.el8.x86_64 11/72 2019-12-19T22:10:09.788 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libbabeltrace-1.5.6-2.el8.x86_64 12/72 2019-12-19T22:10:09.788 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libgfortran-8.2.1-3.5.el8.x86_64 13/72 2019-12-19T22:10:09.788 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 14/72 2019-12-19T22:10:09.788 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libquadmath-8.2.1-3.5.el8.x86_64 15/72 2019-12-19T22:10:09.788 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librabbitmq-0.9.0-1.el8.x86_64 16/72 2019-12-19T22:10:09.788 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libradosstriper1-2:15.0.0-8663.g368c5a4.el8.x86_64 17/72 2019-12-19T22:10:09.788 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 18/72 2019-12-19T22:10:09.789 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librgw2-2:15.0.0-8663.g368c5a4.el8.x86_64 19/72 2019-12-19T22:10:09.789 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/72 2019-12-19T22:10:09.789 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libxslt-1.1.32-3.el8.x86_64 21/72 2019-12-19T22:10:09.789 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openblas-0.3.3-2.el8.x86_64 22/72 2019-12-19T22:10:09.789 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openblas-threads-0.3.3-2.el8.x86_64 23/72 2019-12-19T22:10:09.789 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 24/72 2019-12-19T22:10:09.789 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 25/72 2019-12-19T22:10:09.790 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 26/72 2019-12-19T22:10:09.790 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ceph-argparse-2:15.0.0-8663.g368c5a4.el8.x 27/72 2019-12-19T22:10:09.790 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ceph-common-2:15.0.0-8663.g368c5a4.el8.x86 28/72 2019-12-19T22:10:09.790 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cephfs-2:15.0.0-8663.g368c5a4.el8.x86_64 29/72 2019-12-19T22:10:09.790 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 30/72 2019-12-19T22:10:09.790 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 31/72 2019-12-19T22:10:09.790 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 32/72 2019-12-19T22:10:09.791 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 33/72 2019-12-19T22:10:09.791 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 34/72 2019-12-19T22:10:09.791 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 35/72 2019-12-19T22:10:09.791 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 36/72 2019-12-19T22:10:09.791 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 37/72 2019-12-19T22:10:09.791 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 38/72 2019-12-19T22:10:09.791 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-kubernetes-10.0.1-1.el8.noarch 39/72 2019-12-19T22:10:09.792 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 40/72 2019-12-19T22:10:09.792 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 41/72 2019-12-19T22:10:09.792 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 42/72 2019-12-19T22:10:09.792 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 43/72 2019-12-19T22:10:09.792 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 44/72 2019-12-19T22:10:09.792 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-numpy-1:1.14.3-6.el8.x86_64 45/72 2019-12-19T22:10:09.792 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-numpy-f2py-1:1.14.3-6.el8.x86_64 46/72 2019-12-19T22:10:09.793 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 47/72 2019-12-19T22:10:09.793 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 48/72 2019-12-19T22:10:09.793 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-portend-2.6-1.el8.noarch 49/72 2019-12-19T22:10:09.793 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 50/72 2019-12-19T22:10:09.793 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 51/72 2019-12-19T22:10:09.793 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 52/72 2019-12-19T22:10:09.793 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 53/72 2019-12-19T22:10:09.794 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rados-2:15.0.0-8663.g368c5a4.el8.x86_64 54/72 2019-12-19T22:10:09.794 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rbd-2:15.0.0-8663.g368c5a4.el8.x86_64 55/72 2019-12-19T22:10:09.794 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 56/72 2019-12-19T22:10:09.794 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/72 2019-12-19T22:10:09.794 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rgw-2:15.0.0-8663.g368c5a4.el8.x86_64 58/72 2019-12-19T22:10:09.794 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/72 2019-12-19T22:10:09.794 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rsa-3.4.2-12.el8.noarch 60/72 2019-12-19T22:10:09.795 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-scipy-1.0.0-19.module+el8.0.0+2966+d39a1df 61/72 2019-12-19T22:10:09.795 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 62/72 2019-12-19T22:10:09.795 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 63/72 2019-12-19T22:10:09.795 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 64/72 2019-12-19T22:10:09.795 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-trustme-0.5.2-4.el8.noarch 65/72 2019-12-19T22:10:09.795 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 66/72 2019-12-19T22:10:09.795 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 67/72 2019-12-19T22:10:09.796 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 68/72 2019-12-19T22:10:09.796 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 69/72 2019-12-19T22:10:09.796 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 70/72 2019-12-19T22:10:09.796 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 71/72 2019-12-19T22:10:11.333 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 72/72 2019-12-19T22:10:11.333 INFO:teuthology.orchestra.run.smithi050.stdout:Installed products updated. 2019-12-19T22:10:14.087 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:10:14.087 INFO:teuthology.orchestra.run.smithi050.stdout:Removed: 2019-12-19T22:10:14.087 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-2:15.0.0-8663.g368c5a4.el8.x86_64 2019-12-19T22:10:14.087 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard-2:15.0.0-8663.g368c5a4.el8.noarch 2019-12-19T22:10:14.087 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-diskprediction-cloud-2:15.0.0-8663.g368c5a4.el8.noarch 2019-12-19T22:10:14.087 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-diskprediction-local-2:15.0.0-8663.g368c5a4.el8.noarch 2019-12-19T22:10:14.088 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-rook-2:15.0.0-8663.g368c5a4.el8.noarch 2019-12-19T22:10:14.088 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base-2:15.0.0-8663.g368c5a4.el8.x86_64 2019-12-19T22:10:14.088 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-common-2:15.0.0-8663.g368c5a4.el8.x86_64 2019-12-19T22:10:14.088 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-grafana-dashboards-2:15.0.0-8663.g368c5a4.el8.noarch 2019-12-19T22:10:14.088 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-selinux-2:15.0.0-8663.g368c5a4.el8.x86_64 2019-12-19T22:10:14.088 INFO:teuthology.orchestra.run.smithi050.stdout: gperftools-libs-2.7-6.el8.x86_64 2019-12-19T22:10:14.088 INFO:teuthology.orchestra.run.smithi050.stdout: leveldb-1.21-2.el8.x86_64 2019-12-19T22:10:14.089 INFO:teuthology.orchestra.run.smithi050.stdout: libbabeltrace-1.5.6-2.el8.x86_64 2019-12-19T22:10:14.089 INFO:teuthology.orchestra.run.smithi050.stdout: libgfortran-8.2.1-3.5.el8.x86_64 2019-12-19T22:10:14.089 INFO:teuthology.orchestra.run.smithi050.stdout: liboath-2.6.2-3.el8.x86_64 2019-12-19T22:10:14.089 INFO:teuthology.orchestra.run.smithi050.stdout: libquadmath-8.2.1-3.5.el8.x86_64 2019-12-19T22:10:14.089 INFO:teuthology.orchestra.run.smithi050.stdout: librabbitmq-0.9.0-1.el8.x86_64 2019-12-19T22:10:14.089 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1-2:15.0.0-8663.g368c5a4.el8.x86_64 2019-12-19T22:10:14.089 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka-0.11.4-1.el8.x86_64 2019-12-19T22:10:14.090 INFO:teuthology.orchestra.run.smithi050.stdout: librgw2-2:15.0.0-8663.g368c5a4.el8.x86_64 2019-12-19T22:10:14.090 INFO:teuthology.orchestra.run.smithi050.stdout: libunwind-1.3.1-3.el8.x86_64 2019-12-19T22:10:14.090 INFO:teuthology.orchestra.run.smithi050.stdout: libxslt-1.1.32-3.el8.x86_64 2019-12-19T22:10:14.090 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-0.3.3-2.el8.x86_64 2019-12-19T22:10:14.090 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-threads-0.3.3-2.el8.x86_64 2019-12-19T22:10:14.090 INFO:teuthology.orchestra.run.smithi050.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2019-12-19T22:10:14.090 INFO:teuthology.orchestra.run.smithi050.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2019-12-19T22:10:14.091 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cachetools-3.1.1-4.el8.noarch 2019-12-19T22:10:14.091 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse-2:15.0.0-8663.g368c5a4.el8.x86_64 2019-12-19T22:10:14.091 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common-2:15.0.0-8663.g368c5a4.el8.x86_64 2019-12-19T22:10:14.091 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cephfs-2:15.0.0-8663.g368c5a4.el8.x86_64 2019-12-19T22:10:14.091 INFO:teuthology.orchestra.run.smithi050.stdout: python3-certifi-2018.10.15-7.el8.noarch 2019-12-19T22:10:14.091 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cheroot-8.2.1-1.el8.noarch 2019-12-19T22:10:14.091 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2019-12-19T22:10:14.092 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cssselect-0.9.2-10.el8.noarch 2019-12-19T22:10:14.092 INFO:teuthology.orchestra.run.smithi050.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2019-12-19T22:10:14.092 INFO:teuthology.orchestra.run.smithi050.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2019-12-19T22:10:14.092 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-6.2-6.el8.noarch 2019-12-19T22:10:14.092 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2019-12-19T22:10:14.092 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jwt-1.6.1-2.el8.noarch 2019-12-19T22:10:14.092 INFO:teuthology.orchestra.run.smithi050.stdout: python3-kubernetes-10.0.1-1.el8.noarch 2019-12-19T22:10:14.093 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils-0.3.5-11.el8.noarch 2019-12-19T22:10:14.093 INFO:teuthology.orchestra.run.smithi050.stdout: python3-lxml-4.2.3-1.el8.x86_64 2019-12-19T22:10:14.093 INFO:teuthology.orchestra.run.smithi050.stdout: python3-mako-1.0.6-13.el8.noarch 2019-12-19T22:10:14.093 INFO:teuthology.orchestra.run.smithi050.stdout: python3-markupsafe-0.23-19.el8.x86_64 2019-12-19T22:10:14.093 INFO:teuthology.orchestra.run.smithi050.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2019-12-19T22:10:14.093 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-1:1.14.3-6.el8.x86_64 2019-12-19T22:10:14.093 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-f2py-1:1.14.3-6.el8.x86_64 2019-12-19T22:10:14.094 INFO:teuthology.orchestra.run.smithi050.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2019-12-19T22:10:14.094 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan-1.3.2-9.el8.noarch 2019-12-19T22:10:14.094 INFO:teuthology.orchestra.run.smithi050.stdout: python3-portend-2.6-1.el8.noarch 2019-12-19T22:10:14.094 INFO:teuthology.orchestra.run.smithi050.stdout: python3-prettytable-0.7.2-14.el8.noarch 2019-12-19T22:10:14.094 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2019-12-19T22:10:14.094 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2019-12-19T22:10:14.094 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytz-2017.2-9.el8.noarch 2019-12-19T22:10:14.095 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rados-2:15.0.0-8663.g368c5a4.el8.x86_64 2019-12-19T22:10:14.095 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rbd-2:15.0.0-8663.g368c5a4.el8.x86_64 2019-12-19T22:10:14.095 INFO:teuthology.orchestra.run.smithi050.stdout: python3-repoze-lru-0.7-6.el8.noarch 2019-12-19T22:10:14.096 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2019-12-19T22:10:14.096 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rgw-2:15.0.0-8663.g368c5a4.el8.x86_64 2019-12-19T22:10:14.096 INFO:teuthology.orchestra.run.smithi050.stdout: python3-routes-2.4.1-12.el8.noarch 2019-12-19T22:10:14.096 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rsa-3.4.2-12.el8.noarch 2019-12-19T22:10:14.096 INFO:teuthology.orchestra.run.smithi050.stdout: python3-scipy-1.0.0-19.module+el8.0.0+2966+d39a1df3.x86_64 2019-12-19T22:10:14.096 INFO:teuthology.orchestra.run.smithi050.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2019-12-19T22:10:14.097 INFO:teuthology.orchestra.run.smithi050.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2019-12-19T22:10:14.097 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempora-1.14.1-5.el8.noarch 2019-12-19T22:10:14.097 INFO:teuthology.orchestra.run.smithi050.stdout: python3-trustme-0.5.2-4.el8.noarch 2019-12-19T22:10:14.097 INFO:teuthology.orchestra.run.smithi050.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2019-12-19T22:10:14.097 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webencodings-0.5.1-6.el8.noarch 2019-12-19T22:10:14.097 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob-1.8.5-1.el8.1.noarch 2019-12-19T22:10:14.097 INFO:teuthology.orchestra.run.smithi050.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2019-12-19T22:10:14.098 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webtest-2.0.33-1.el8.noarch 2019-12-19T22:10:14.098 INFO:teuthology.orchestra.run.smithi050.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2019-12-19T22:10:14.098 INFO:teuthology.orchestra.run.smithi050.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2019-12-19T22:10:14.098 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:10:14.098 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2019-12-19T22:10:14.643 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2019-12-19T22:10:15.201 INFO:teuthology.orchestra.run.smithi050.stdout:No match for argument: ceph-mgr-dashboard 2019-12-19T22:10:15.201 INFO:teuthology.orchestra.run.smithi050.stderr:No packages marked for removal. 2019-12-19T22:10:15.205 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2019-12-19T22:10:15.206 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2019-12-19T22:10:15.207 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2019-12-19T22:10:15.626 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2019-12-19T22:10:16.248 INFO:teuthology.orchestra.run.smithi050.stdout:No match for argument: ceph-mgr-diskprediction-cloud 2019-12-19T22:10:16.249 INFO:teuthology.orchestra.run.smithi050.stderr:No packages marked for removal. 2019-12-19T22:10:16.252 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2019-12-19T22:10:16.254 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2019-12-19T22:10:16.254 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2019-12-19T22:10:16.673 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2019-12-19T22:10:17.230 INFO:teuthology.orchestra.run.smithi050.stdout:No match for argument: ceph-mgr-diskprediction-local 2019-12-19T22:10:17.230 INFO:teuthology.orchestra.run.smithi050.stderr:No packages marked for removal. 2019-12-19T22:10:17.234 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2019-12-19T22:10:17.235 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2019-12-19T22:10:17.235 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2019-12-19T22:10:17.651 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2019-12-19T22:10:18.209 INFO:teuthology.orchestra.run.smithi050.stdout:No match for argument: ceph-mgr-rook 2019-12-19T22:10:18.209 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2019-12-19T22:10:18.209 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2019-12-19T22:10:18.210 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2019-12-19T22:10:18.210 INFO:teuthology.orchestra.run.smithi050.stderr:No packages marked for removal. 2019-12-19T22:10:18.636 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2019-12-19T22:10:19.293 INFO:teuthology.orchestra.run.smithi050.stdout:No match for argument: ceph-mgr-cephadm 2019-12-19T22:10:19.293 INFO:teuthology.orchestra.run.smithi050.stderr:No packages marked for removal. 2019-12-19T22:10:19.297 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2019-12-19T22:10:19.299 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2019-12-19T22:10:19.299 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2019-12-19T22:10:19.786 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2019-12-19T22:10:20.429 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2019-12-19T22:10:20.430 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:10:20.430 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2019-12-19T22:10:20.430 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:10:20.430 INFO:teuthology.orchestra.run.smithi050.stdout:Removing: 2019-12-19T22:10:20.431 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-fuse x86_64 2:15.0.0-8663.g368c5a4.el8 2019-12-19T22:10:20.431 INFO:teuthology.orchestra.run.smithi050.stdout: @ceph 1.8 M 2019-12-19T22:10:20.431 INFO:teuthology.orchestra.run.smithi050.stdout:Removing unused dependencies: 2019-12-19T22:10:20.431 INFO:teuthology.orchestra.run.smithi050.stdout: fuse x86_64 2.9.7-12.el8 @rhel-8-for-x86_64-baseos-rpms 206 k 2019-12-19T22:10:20.432 INFO:teuthology.orchestra.run.smithi050.stdout: fuse-common x86_64 3.2.1-12.el8 @rhel-8-for-x86_64-baseos-rpms 4.7 k 2019-12-19T22:10:20.432 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:10:20.432 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2019-12-19T22:10:20.433 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:10:20.433 INFO:teuthology.orchestra.run.smithi050.stdout:Remove 3 Packages 2019-12-19T22:10:20.433 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:10:20.433 INFO:teuthology.orchestra.run.smithi050.stdout:Freed space: 2.0 M 2019-12-19T22:10:20.433 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2019-12-19T22:10:20.434 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2019-12-19T22:10:20.435 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2019-12-19T22:10:20.468 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2019-12-19T22:10:20.469 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2019-12-19T22:10:20.560 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2019-12-19T22:10:20.560 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-fuse-2:15.0.0-8663.g368c5a4.el8.x86_64 1/1 2019-12-19T22:10:20.560 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : ceph-fuse-2:15.0.0-8663.g368c5a4.el8.x86_64 1/3 2019-12-19T22:10:20.764 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-fuse-2:15.0.0-8663.g368c5a4.el8.x86_64 1/3 2019-12-19T22:10:20.904 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : fuse-2.9.7-12.el8.x86_64 2/3 2019-12-19T22:10:20.905 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : fuse-common-3.2.1-12.el8.x86_64 3/3 2019-12-19T22:10:20.905 INFO:teuthology.orchestra.run.smithi050.stdout:warning: /etc/fuse.conf saved as /etc/fuse.conf.rpmsave 2019-12-19T22:10:20.905 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:10:21.170 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: fuse-common-3.2.1-12.el8.x86_64 3/3 2019-12-19T22:10:21.171 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-fuse-2:15.0.0-8663.g368c5a4.el8.x86_64 1/3 2019-12-19T22:10:21.171 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/3 2019-12-19T22:10:21.551 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 3/3 2019-12-19T22:10:21.551 INFO:teuthology.orchestra.run.smithi050.stdout:Installed products updated. 2019-12-19T22:10:24.201 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:10:24.201 INFO:teuthology.orchestra.run.smithi050.stdout:Removed: 2019-12-19T22:10:24.201 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-fuse-2:15.0.0-8663.g368c5a4.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2019-12-19T22:10:24.201 INFO:teuthology.orchestra.run.smithi050.stdout: fuse-common-3.2.1-12.el8.x86_64 2019-12-19T22:10:24.201 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:10:24.201 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2019-12-19T22:10:24.741 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2019-12-19T22:10:25.371 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2019-12-19T22:10:25.372 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:10:25.372 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository 2019-12-19T22:10:25.372 INFO:teuthology.orchestra.run.smithi050.stdout: Size 2019-12-19T22:10:25.372 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:10:25.372 INFO:teuthology.orchestra.run.smithi050.stdout:Removing: 2019-12-19T22:10:25.373 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs2 x86_64 2:15.0.0-8663.g368c5a4.el8 @ceph 1.5 M 2019-12-19T22:10:25.373 INFO:teuthology.orchestra.run.smithi050.stdout:Removing dependent packages: 2019-12-19T22:10:25.373 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs-devel x86_64 2:15.0.0-8663.g368c5a4.el8 @ceph 75 k 2019-12-19T22:10:25.373 INFO:teuthology.orchestra.run.smithi050.stdout:Removing unused dependencies: 2019-12-19T22:10:25.373 INFO:teuthology.orchestra.run.smithi050.stdout: librados-devel x86_64 2:15.0.0-8663.g368c5a4.el8 @ceph 530 k 2019-12-19T22:10:25.373 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:10:25.373 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2019-12-19T22:10:25.374 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:10:25.374 INFO:teuthology.orchestra.run.smithi050.stdout:Remove 3 Packages 2019-12-19T22:10:25.374 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:10:25.374 INFO:teuthology.orchestra.run.smithi050.stdout:Freed space: 2.1 M 2019-12-19T22:10:25.374 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2019-12-19T22:10:25.376 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2019-12-19T22:10:25.376 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2019-12-19T22:10:25.405 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2019-12-19T22:10:25.406 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2019-12-19T22:10:25.476 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2019-12-19T22:10:25.604 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : libcephfs-devel-2:15.0.0-8663.g368c5a4.el8.x86_64 1/3 2019-12-19T22:10:25.604 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : libcephfs2-2:15.0.0-8663.g368c5a4.el8.x86_64 2/3 2019-12-19T22:10:25.804 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libcephfs2-2:15.0.0-8663.g368c5a4.el8.x86_64 2/3 2019-12-19T22:10:25.940 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : librados-devel-2:15.0.0-8663.g368c5a4.el8.x86_64 3/3 2019-12-19T22:10:26.124 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados-devel-2:15.0.0-8663.g368c5a4.el8.x86_64 3/3 2019-12-19T22:10:26.125 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephfs-devel-2:15.0.0-8663.g368c5a4.el8.x86_64 1/3 2019-12-19T22:10:26.125 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephfs2-2:15.0.0-8663.g368c5a4.el8.x86_64 2/3 2019-12-19T22:10:26.515 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados-devel-2:15.0.0-8663.g368c5a4.el8.x86_64 3/3 2019-12-19T22:10:26.515 INFO:teuthology.orchestra.run.smithi050.stdout:Installed products updated. 2019-12-19T22:10:29.533 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:10:29.533 INFO:teuthology.orchestra.run.smithi050.stdout:Removed: 2019-12-19T22:10:29.533 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs2-2:15.0.0-8663.g368c5a4.el8.x86_64 2019-12-19T22:10:29.533 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs-devel-2:15.0.0-8663.g368c5a4.el8.x86_64 2019-12-19T22:10:29.533 INFO:teuthology.orchestra.run.smithi050.stdout: librados-devel-2:15.0.0-8663.g368c5a4.el8.x86_64 2019-12-19T22:10:29.534 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:10:29.534 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2019-12-19T22:10:30.053 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2019-12-19T22:10:30.588 INFO:teuthology.orchestra.run.smithi050.stdout:No match for argument: libcephfs-devel 2019-12-19T22:10:30.588 INFO:teuthology.orchestra.run.smithi050.stderr:No packages marked for removal. 2019-12-19T22:10:30.592 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2019-12-19T22:10:30.596 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2019-12-19T22:10:30.596 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2019-12-19T22:10:31.029 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2019-12-19T22:10:31.679 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2019-12-19T22:10:31.681 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:10:31.681 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2019-12-19T22:10:31.682 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:10:31.682 INFO:teuthology.orchestra.run.smithi050.stdout:Removing: 2019-12-19T22:10:31.682 INFO:teuthology.orchestra.run.smithi050.stdout: librados2 x86_64 2:15.0.0-8663.g368c5a4.el8 2019-12-19T22:10:31.682 INFO:teuthology.orchestra.run.smithi050.stdout: @ceph 15 M 2019-12-19T22:10:31.682 INFO:teuthology.orchestra.run.smithi050.stdout:Removing dependent packages: 2019-12-19T22:10:31.682 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-fuse x86_64 2:15.0.0-8663.g368c5a4.el8 2019-12-19T22:10:31.683 INFO:teuthology.orchestra.run.smithi050.stdout: @ceph 214 k 2019-12-19T22:10:31.683 INFO:teuthology.orchestra.run.smithi050.stdout:Removing unused dependencies: 2019-12-19T22:10:31.683 INFO:teuthology.orchestra.run.smithi050.stdout: libibverbs x86_64 22-2.el8 @rhel-8-for-x86_64-baseos-rpms 626 k 2019-12-19T22:10:31.683 INFO:teuthology.orchestra.run.smithi050.stdout: librbd1 x86_64 2:15.0.0-8663.g368c5a4.el8 2019-12-19T22:10:31.683 INFO:teuthology.orchestra.run.smithi050.stdout: @ceph 8.2 M 2019-12-19T22:10:31.683 INFO:teuthology.orchestra.run.smithi050.stdout: librdmacm x86_64 22-2.el8 @rhel-8-for-x86_64-baseos-rpms 129 k 2019-12-19T22:10:31.684 INFO:teuthology.orchestra.run.smithi050.stdout: lttng-ust x86_64 2.8.1-11.el8 @lab-extras 1.0 M 2019-12-19T22:10:31.684 INFO:teuthology.orchestra.run.smithi050.stdout: rdma-core x86_64 22-2.el8 @rhel-8-for-x86_64-baseos-rpms 97 k 2019-12-19T22:10:31.684 INFO:teuthology.orchestra.run.smithi050.stdout: userspace-rcu x86_64 0.10.1-2.el8 @rhel-8-for-x86_64-baseos-rpms 325 k 2019-12-19T22:10:31.684 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:10:31.684 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2019-12-19T22:10:31.684 INFO:teuthology.orchestra.run.smithi050.stdout:================================================================================ 2019-12-19T22:10:31.685 INFO:teuthology.orchestra.run.smithi050.stdout:Remove 8 Packages 2019-12-19T22:10:31.685 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:10:31.685 INFO:teuthology.orchestra.run.smithi050.stdout:Freed space: 26 M 2019-12-19T22:10:31.686 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2019-12-19T22:10:31.687 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2019-12-19T22:10:31.687 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2019-12-19T22:10:31.726 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2019-12-19T22:10:31.726 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2019-12-19T22:10:31.851 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2019-12-19T22:10:31.861 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: rbd-fuse-2:15.0.0-8663.g368c5a4.el8.x86_64 1/1 2019-12-19T22:10:32.029 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : rbd-fuse-2:15.0.0-8663.g368c5a4.el8.x86_64 1/8 2019-12-19T22:10:32.029 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : librbd1-2:15.0.0-8663.g368c5a4.el8.x86_64 2/8 2019-12-19T22:10:32.237 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librbd1-2:15.0.0-8663.g368c5a4.el8.x86_64 2/8 2019-12-19T22:10:32.237 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : librados2-2:15.0.0-8663.g368c5a4.el8.x86_64 3/8 2019-12-19T22:10:32.238 INFO:teuthology.orchestra.run.smithi050.stdout:warning: file /etc/ceph: remove failed: No such file or directory 2019-12-19T22:10:32.238 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:10:32.428 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados2-2:15.0.0-8663.g368c5a4.el8.x86_64 3/8 2019-12-19T22:10:32.429 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : librdmacm-22-2.el8.x86_64 4/8 2019-12-19T22:10:32.622 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librdmacm-22-2.el8.x86_64 4/8 2019-12-19T22:10:32.623 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : lttng-ust-2.8.1-11.el8.x86_64 5/8 2019-12-19T22:10:32.831 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/8 2019-12-19T22:10:32.831 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : libibverbs-22-2.el8.x86_64 6/8 2019-12-19T22:10:33.040 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libibverbs-22-2.el8.x86_64 6/8 2019-12-19T22:10:33.040 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : rdma-core-22-2.el8.x86_64 7/8 2019-12-19T22:10:33.321 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: rdma-core-22-2.el8.x86_64 7/8 2019-12-19T22:10:33.321 INFO:teuthology.orchestra.run.smithi050.stdout: Erasing : userspace-rcu-0.10.1-2.el8.x86_64 8/8 2019-12-19T22:10:33.721 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: userspace-rcu-0.10.1-2.el8.x86_64 8/8 2019-12-19T22:10:33.721 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libibverbs-22-2.el8.x86_64 1/8 2019-12-19T22:10:33.721 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados2-2:15.0.0-8663.g368c5a4.el8.x86_64 2/8 2019-12-19T22:10:33.721 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librbd1-2:15.0.0-8663.g368c5a4.el8.x86_64 3/8 2019-12-19T22:10:33.722 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librdmacm-22-2.el8.x86_64 4/8 2019-12-19T22:10:33.722 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 5/8 2019-12-19T22:10:33.722 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-fuse-2:15.0.0-8663.g368c5a4.el8.x86_64 6/8 2019-12-19T22:10:33.722 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rdma-core-22-2.el8.x86_64 7/8 2019-12-19T22:10:34.161 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : userspace-rcu-0.10.1-2.el8.x86_64 8/8 2019-12-19T22:10:34.161 INFO:teuthology.orchestra.run.smithi050.stdout:Installed products updated. 2019-12-19T22:10:36.886 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:10:36.887 INFO:teuthology.orchestra.run.smithi050.stdout:Removed: 2019-12-19T22:10:36.887 INFO:teuthology.orchestra.run.smithi050.stdout: librados2-2:15.0.0-8663.g368c5a4.el8.x86_64 2019-12-19T22:10:36.887 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-fuse-2:15.0.0-8663.g368c5a4.el8.x86_64 2019-12-19T22:10:36.887 INFO:teuthology.orchestra.run.smithi050.stdout: libibverbs-22-2.el8.x86_64 2019-12-19T22:10:36.887 INFO:teuthology.orchestra.run.smithi050.stdout: librbd1-2:15.0.0-8663.g368c5a4.el8.x86_64 2019-12-19T22:10:36.887 INFO:teuthology.orchestra.run.smithi050.stdout: librdmacm-22-2.el8.x86_64 2019-12-19T22:10:36.887 INFO:teuthology.orchestra.run.smithi050.stdout: lttng-ust-2.8.1-11.el8.x86_64 2019-12-19T22:10:36.888 INFO:teuthology.orchestra.run.smithi050.stdout: rdma-core-22-2.el8.x86_64 2019-12-19T22:10:36.888 INFO:teuthology.orchestra.run.smithi050.stdout: userspace-rcu-0.10.1-2.el8.x86_64 2019-12-19T22:10:36.888 INFO:teuthology.orchestra.run.smithi050.stdout: 2019-12-19T22:10:36.888 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2019-12-19T22:10:37.412 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2019-12-19T22:10:37.961 INFO:teuthology.orchestra.run.smithi050.stdout:No match for argument: librbd1 2019-12-19T22:10:37.961 INFO:teuthology.orchestra.run.smithi050.stderr:No packages marked for removal. 2019-12-19T22:10:37.964 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2019-12-19T22:10:37.966 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2019-12-19T22:10:37.966 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2019-12-19T22:10:38.406 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2019-12-19T22:10:39.237 INFO:teuthology.orchestra.run.smithi050.stdout:No match for argument: python3-rados 2019-12-19T22:10:39.237 INFO:teuthology.orchestra.run.smithi050.stderr:No packages marked for removal. 2019-12-19T22:10:39.241 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2019-12-19T22:10:39.242 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2019-12-19T22:10:39.243 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2019-12-19T22:10:39.679 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2019-12-19T22:10:40.238 INFO:teuthology.orchestra.run.smithi050.stdout:No match for argument: python3-rgw 2019-12-19T22:10:40.238 INFO:teuthology.orchestra.run.smithi050.stderr:No packages marked for removal. 2019-12-19T22:10:40.242 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2019-12-19T22:10:40.243 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2019-12-19T22:10:40.243 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2019-12-19T22:10:40.676 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2019-12-19T22:10:41.287 INFO:teuthology.orchestra.run.smithi050.stdout:No match for argument: python3-cephfs 2019-12-19T22:10:41.288 INFO:teuthology.orchestra.run.smithi050.stderr:No packages marked for removal. 2019-12-19T22:10:41.288 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2019-12-19T22:10:41.289 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2019-12-19T22:10:41.289 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2019-12-19T22:10:41.726 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2019-12-19T22:10:42.376 INFO:teuthology.orchestra.run.smithi050.stdout:No match for argument: python3-rbd 2019-12-19T22:10:42.376 INFO:teuthology.orchestra.run.smithi050.stderr:No packages marked for removal. 2019-12-19T22:10:42.380 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2019-12-19T22:10:42.381 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2019-12-19T22:10:42.381 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2019-12-19T22:10:42.820 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2019-12-19T22:10:43.749 INFO:teuthology.orchestra.run.smithi050.stdout:No match for argument: rbd-fuse 2019-12-19T22:10:43.749 INFO:teuthology.orchestra.run.smithi050.stderr:No packages marked for removal. 2019-12-19T22:10:43.753 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2019-12-19T22:10:43.754 INFO:teuthology.orchestra.run.smithi050.stdout:Nothing to do. 2019-12-19T22:10:43.754 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2019-12-19T22:10:43.872 INFO:teuthology.orchestra.run.smithi050:> sudo yum clean all 2019-12-19T22:10:44.219 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2019-12-19T22:10:44.711 INFO:teuthology.orchestra.run.smithi050.stdout:52 files removed 2019-12-19T22:10:44.756 INFO:teuthology.orchestra.run.smithi050:> sudo lsb_release -is 2019-12-19T22:10:44.796 INFO:teuthology.orchestra.run.smithi050.stdout:RedHatEnterprise 2019-12-19T22:10:44.797 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2019-12-19T22:10:44.797 INFO:teuthology.orchestra.run.smithi050:> sudo rm -f /etc/yum.repos.d/ceph.repo 2019-12-19T22:10:44.874 INFO:teuthology.orchestra.run.smithi050:> sudo yum clean expire-cache 2019-12-19T22:10:45.259 INFO:teuthology.orchestra.run.smithi050.stdout:Updating Subscription Management repositories. 2019-12-19T22:10:45.718 INFO:teuthology.orchestra.run.smithi050.stdout:Cache was expired 2019-12-19T22:10:45.719 INFO:teuthology.orchestra.run.smithi050.stdout:0 files removed 2019-12-19T22:10:45.762 DEBUG:teuthology.parallel:result is None 2019-12-19T22:10:45.762 INFO:teuthology.task.install:Removing ceph sources lists 2019-12-19T22:10:45.763 INFO:teuthology.orchestra.run.smithi050:> sudo lsb_release -is 2019-12-19T22:10:45.802 INFO:teuthology.orchestra.run.smithi050.stdout:RedHatEnterprise 2019-12-19T22:10:45.803 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2019-12-19T22:10:45.803 INFO:teuthology.orchestra.run.smithi050:> sudo rm -f /etc/yum.repos.d/ceph.repo 2019-12-19T22:10:45.874 INFO:teuthology.orchestra.run.smithi050:> sudo mv -f /etc/yum/pluginconf.d/priorities.conf.orig /etc/yum/pluginconf.d/priorities.conf 2019-12-19T22:10:45.945 DEBUG:teuthology.parallel:result is None 2019-12-19T22:10:45.945 DEBUG:teuthology.run_tasks:Unwinding manager clock 2019-12-19T22:10:45.958 INFO:teuthology.task.clock:Checking final clock skew... 2019-12-19T22:10:45.958 INFO:teuthology.orchestra.run.smithi050:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2019-12-19T22:10:45.999 INFO:teuthology.orchestra.run.smithi050.stderr:bash: ntpq: command not found 2019-12-19T22:10:46.002 INFO:teuthology.orchestra.run.smithi050.stdout:210 Number of sources = 4 2019-12-19T22:10:46.003 INFO:teuthology.orchestra.run.smithi050.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2019-12-19T22:10:46.003 INFO:teuthology.orchestra.run.smithi050.stdout:=============================================================================== 2019-12-19T22:10:46.003 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv01.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2019-12-19T22:10:46.003 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv02.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2019-12-19T22:10:46.003 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv03.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2019-12-19T22:10:46.003 INFO:teuthology.orchestra.run.smithi050.stdout:^* hv04.front.sepia.ceph.com 3 6 377 14 +8880ns[ +86us] +/- 25ms 2019-12-19T22:10:46.004 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2019-12-19T22:10:46.021 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2019-12-19T22:10:46.021 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2019-12-19T22:10:46.037 INFO:teuthology.orchestra.run.smithi050:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2019-12-19T22:10:46.112 INFO:teuthology.orchestra.run.smithi050:> sudo grep 'avc: .*denied' /var/log/audit/audit.log | grep -v '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\)' 2019-12-19T22:10:46.144 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-12-19T22:10:46.145 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2019-12-19T22:10:46.160 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2019-12-19T22:10:46.196 INFO:teuthology.task.internal:Duration was 631.219655 seconds 2019-12-19T22:10:46.196 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2019-12-19T22:10:46.213 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2019-12-19T22:10:46.213 INFO:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2019-12-19T22:10:46.271 INFO:teuthology.orchestra.run.smithi050.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2019-12-19T22:10:46.458 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2019-12-19T22:10:46.458 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi050.front.sepia.ceph.com 2019-12-19T22:10:46.459 INFO:teuthology.orchestra.run.smithi050:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/*.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2019-12-19T22:10:46.478 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2019-12-19T22:10:46.479 INFO:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2019-12-19T22:10:46.560 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2019-12-19T22:10:46.574 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2019-12-19T22:10:46.575 INFO:teuthology.orchestra.run.smithi050:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2019-12-19T22:10:46.630 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2019-12-19T22:10:46.646 INFO:teuthology.orchestra.run.smithi050:> sudo sysctl -w kernel.core_pattern=core && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2019-12-19T22:10:46.701 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = core 2019-12-19T22:10:46.703 INFO:teuthology.orchestra.run.smithi050:> test -e /home/ubuntu/cephtest/archive/coredump 2019-12-19T22:10:46.757 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-12-19T22:10:46.757 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2019-12-19T22:10:46.775 INFO:teuthology.task.internal:Transferring archived files... 2019-12-19T22:10:46.776 DEBUG:teuthology.misc:Transferring archived files from smithi050:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/sjust-2019-12-19_20:06:11-rados-wip-sjust-read-from-replica-distro-basic-smithi/4615662/remote/smithi050 2019-12-19T22:10:46.776 INFO:teuthology.orchestra.run.smithi050:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2019-12-19T22:10:46.841 INFO:teuthology.task.internal:Removing archive directory... 2019-12-19T22:10:46.842 INFO:teuthology.orchestra.run.smithi050:> rm -rf -- /home/ubuntu/cephtest/archive 2019-12-19T22:10:46.890 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2019-12-19T22:10:46.908 INFO:teuthology.task.internal:Not uploading archives. 2019-12-19T22:10:46.908 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2019-12-19T22:10:46.923 INFO:teuthology.task.internal:Tidying up after the test... 2019-12-19T22:10:46.923 INFO:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2019-12-20T09:54:28.495 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2019-12-20T09:54:28.506 DEBUG:teuthology.task.console_log:Killing console logger for smithi050 2019-12-20T09:54:28.506 DEBUG:teuthology.task.console_log:Killing console logger for smithi050 2019-12-20T09:54:28.506 DEBUG:teuthology.exit:Finished running handlers